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THE CLINICAL PSYCHOLOGIST IN AN 
INSTITUTION FOR MENTAL 
DEFECTIVES 


MILTON COTZIN 


SOUTHBURY TRAINING SCHOOL, SOUTHBURY, CONNECTICUT 


URING the past few years, many ar- 
ticles have been written about the 
functions and duties of the clinical 

psychologist in a variety of professional agen- 
cies, but there is almost no literature on his role 
in residential schools and hospitals for the 
mentally defective. This is particularly curious 
in view of the facts that clinical psychology 
had an early impetus from work done with the 
defective and that state institutions have long 
depended on the psychologist’s skills. 

In 1940, Hackbusch [4] found that psy- 
chology in institutions for mental defectives is 
a heterogeneous affair with wide ranges of 
training and practices. In about half of the 
nore than one hundred schools canvassed, test- 
ing was done by personnel other than psycholo- 
gists, and the qualifications of those classified 
as psychologists were generally substandard. 
She recommended that the standards pub- 
lished by the New York City Committee for 
Mental Hygiene be adopted for psychological 
personnel in institutions, and also that the part 
played by the psychologist in the commitment 
procedure be clarified. As yet, minimal re- 
quirements for such personnel have not been 
met. 

Administrative officials of many institutions 
admittedly do not know and must become ac- 
quainted with the skills of the clinical psy- 
chologist and the effective role he can play in 
the study, care, and training of the defective. 
Because of this lack of knowledge and the 
prevalence in the field of unqualified psycholo- 
gists, such institutions often do not offer ade- 
quate staff rank, salaries, housing facilities, 
and opportunity for professional growth to at- 
tract the well qualified and mature clinician. 
At the same time, graduate curricula in clini- 
cal psychology generally do not include courses 
and field training which would stimulate the 
student’s interest in the field of mental defi- 


ciency, awaken him to its potentialities, and 
cause him to choose that area for his career. 
Thus, too many so-called psychologists who are 
content to serve as psychometricians are on the 
staffs of these institutions and provide for the 
administrators a picture of psychological ser- 
vices which is almost completely static and 
sterile. The wonderful opportunity both for 
the clinical psychologist and for the institution 
is lost in a vicious circle. 

Kinder [5] in 1937 and Doll [3] in 1940 
described the activities of psychological per- 
sonnel in institutions for the mentally defective, 
namely clinical and psychometric service, re- 
search, and education. Service required mental 
examination of the inmate for purposes of 
classification, placement, and training. Research 
activity included investigations designed to ad- 
vance knowledge and to improve practice, and 
the topics were essentially those involved in 
the service activity. Education involved the 
spreading of psychological knowledge and ex- 
perience through conferences, addresses, sys- 
tematic teaching, and publication. 

The activities outlined by Kinder and by 
Doll are undoubtedly carried out by psy- 
chologists in institutions, but in varying de- 
grees. There is little question that in many in- 
stitutions the primary duty of the psychologist 
is that of service for the purpose of a mental 
classification. This is considered by the writer 
to be the function of a psychometrician and not 
that of a clinical psychologist. In some settings, 
in addition to rendering a classification service, 
the psychologist may stand apart from the 
everyday activities of the institution and con- 
duct pure research. Such an activity may have 
long-range application to a better understand- 
ing of the defective, but in many cases such re- 
search is frowned upon by administrators since 
it appears to them to have no immediate prac- 
tical value. There is no reason why research 
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cannot be conducted in conjunction with serv- 
ice. Educational activities are carried on by 
psychologists in institutions but these are 
limited not only by the qualifications of the 
psychologist but also by the professional status 
given him by the administrative officials. 

In each of these three activities, clinical psy- 
chology as a science has advanced markedly 
during the last few years not only in its tech- 
niques, but also in a better understanding of 
the patient. In addition, the clinical psycholo- 
gist is receiving recognition for competent pro- 
fessional service in other activities and respon- 
sibilities. In the schools for defectives, as well 
as in some other agencies, such advances have 
not been fully accepted and put into operation. 
Finally, the psychologist has had little to do 
with administrative policy and has been given 
almost no direct authority over the study, care, 
and treatment of the patients. 

The purpose of this paper is to describe the 
role which the clinical psychologist plays at 
the Southbury Training School, a residential 
school for mentally defective and epileptic in- 
dividuals. This training school recognizes 
that a psychologist is the person who probably 
knows the most about dynamics of behavior 
and causes of maladjustment, and thus his role 
includes professional independence, freedom to 
inaugurate any current developments in psy- 
chology, and a rank on the top-level adminis- 
trative staff. 


FUNCTIONAL ORGANIZATION OF THE 
TRAINING SCHOOL 


In order to understand the psychologist’s 
work at the Southbury Training School, it is 
necessary to know the institution’s program in 
which the psychology department has a guiding 
role. Since its opening in October, 1940, the 
basic philosophy of Southbury has been that 
the problem of mental defect is in its major 
aspects a problem of training, and that a con- 
stant attempt must be made to condition the 
defective to live as happily and purposefully 
as his capacities permit. Buildings and plant 
were organized on the cottage plan to permit 
conditions approaching as closely as possible 
those of a normal home and community. Each 
cottage has its own kitchen, dining room, living 
room, bedrooms, dormitories, and playrooms, 
and houses from 18 to 36 individuals selected 


to form as homogeneous a group as possible. 

At the present time the Southbury Training 
School cares for approximately 1400 individu- 
als all of whom are admitted either through 
Probate or Juvenile Court. The age range is 
from under 5 to over 40 years of age, with a 
median of approximately 21. About 25 per 
cent of the population can be classified as low- 
grade, 25 per cent as middle-grade, and the re- 
maining 50 per cent as high-grade or border- 
line. There are no special housing facilities for 
the non-defective epileptics. 

There is a departmental plan of administra- 
tion, each department head being responsible 
to the superintendent. The eight departments 
are: medical and health service, cottage life, 
training and education, social service, psycho- 
logical service, business, plant and maintenance, 
and farm. The latter three are concerned only 
indirectly with the welfare of the individual 
patient. 

The medical department is responsible for 
the health of the population in a capacity simi- 
lar to that of the family physician. In addition, 
it has full charge of all low-grade children and 
the tubercular patients. This department de- 
termines the etiology of the mental defect. 

The cottage life department supervises and 
coordinates all of the activities of the children 
within their cottages. The training and educa- 
tion department is responsible for the academic 
and vocational training in the schools, work- 
shops, special units, and in jobs throughout the 
institution. 

Since the case history on the child has al- 
ready been taken by a central social service of- 
fice in Hartford, the social service department 
at Southbury is responsible for establishing 
contact with the child’s family after admission, 
evaluating the possibility of vacations and 
future returns of the child to the home, and 
investigating placement possibilities outside the 
home. This department also supervises those 
children who are on any type of community 
placement from the institution. 

Within this departmental framework, the 
Department of Psychological Service forms an 
integrating or focal point for the proper carry- 
ing through of the basic philosophy of the 
Southbury Training School. This department 
sets up standards for dealing with the children, 
and in its attempts to deepen an understanding 
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of the defective, focuses its clinical attention 
and interest upon fundamental problems in- 
volved. The clinical psychologist fosters the 
belief that the first step in the care and training 
of a child is an understanding of his particular 
needs and strengths, and the viewing of him as 
a total individual. With this in mind, the clini- 
cal psychologist is charged with the responsibil- 
ity of the direction of (1) the child study com- 
mittee, (2) the behavior clinic, (3) the out- 
patient clinic, (4) the psychological research 
program, and (5) the psychological consultant 
and educational services within and outside the 
institution. 


COMMITTEE ON CHILD STUDY 


Function. The proper receiving of children 
into the training school, their subsequent as- 
signment to cottages and to the care and train- 
ing program, their direction in this program, 
the study and measurement of their progress 
at periodic intervals, and the eventual place- 
ment out into the community of those capable 
of such opportunity, constitute the major func- 
tion of the Southbury Training School. The 
organization responsible for the performance 
of this function is the Committee on Child 
Study, Care and Training, which has as its co- 
chairmen the Director of Psychological Serv- 
ice, in charge of the Child Study Section, and 
the Director of Training, in charge of the 
Care and Training Section. Other members 
are: the directors of the Medical, the Cottage 
Life, and the Social Service Departments, and 
the principal of schools, supervisor of boys, 
supervisor of girls, supervisor of infirm, senior 
occupational therapist, and the registrar as sec- 
retary. Since the psychological studies sub- 
mitted to this Committee are a complete de- 
parture from the traditional classification and 
psychometrics of the institutional psychologist, 
a detailed description of these qualitative 
studies is now given. 


Procedure. After a child has been admitted 
to the training school and temporarily assigned 
to a cottage and training program, he is sched- 
uled by the clinical psychologist for discussion 
at the Committee meeting. Since emotional 
factors and initial adjustment problems pre- 
clude valid observations of a child upon admis- 
sion, no child is scheduled for study until after 
at least one month in his temporary assign- 


ments. The agenda are sent out by the Depart- 
ment of Psychological Service two weeks prior 
to meetings ; during the first of these two weeks 
each department concerned prepares a report 
on the child and submits that report to the Psy- 
chology Department; the second week is for 
study of the child by the clinical psychologist 
who now has in his possession the case history, 
medical status, social service description of the 
home and family, and evaluations of the child’s 
adjustment and progress in his cottage and 
training assignments. 


On the basis of the case history, the depart- 
mental reports, and his own study and obser- 
vations, the clinical psychologist develops an 
over-all master report covering the child’s 
probable intellectual and emotional capacities 
and limitations, the classification and diagnosis, 
recommendations as to cottage assignment, 
training program and placement possibilities, 
and the prognosis. As co-chairman of the Com- 
mittee On Child Study, Care and Training, 
the psychologist presents this integrated report 
to the Committee. His responsibility in this 
weekly conference is that of a clinician, and as 
such he makes every member of the Committee 
as familiar as possible with the pertinent facts 
which need to be known about the child. On 
the basis of this open conference, programs for 
the child are formulated. 

Content of Studies. Few papers have been 
written on diagnostic methods in mental de- 
ficiency. Except in cases of obvious low-grade 
mentality, where there are usually clear neuro- 
logical signs of extensive central nervous system 
damage, a diagnosis of mental deficiency can- 
not be made accurately without psychological 
tests. Sarason and Sarason [6] list five cri- 
teria for evaluation of the clinical psychologist’s 
findings in the diagnosis of mental deficiency: 
(1) a psychological examination which in- 
cludes several measures of intelligence on the 
individual type of test; (2) a careful evalua- 
tion of the personality organization by means 
of projective techniques, involving also a search 
for the relationship in each case between intel- 
ligence and personality; (3) an analysis of 
each test to determine the extent of internal 
consistency and resemblance of the test pattern 
to a clinical picture; (4) an interpretation of 
the test results in the light of the outstanding 
features of the past or present environment 
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which might have affected functioning and are 
reflected in the examination; and (5) the fore- 
going information presented so that one gets a 
total picture in which all features of the ex- 
amination are related. 


Davis [2], discussing the two major diag- 
nostic methods in clinical psychology, the an- 
amnestic and the psychometric, concludes that 
both biographical and psychometric data play 
a significant role in the formation of clinical 
judgments. The relative importance of each 
is determined by the type of clinical problem 
under discussion. He states that clinicians can- 
not dispense with either of these sources of di- 
agnostic insight. 


The clinical psychologist at the Southbury 
Training School, in his over-all study of the in- 
dividual child, has put into effect the criteria 
proposed by Sarason and Sarason and the 
methods discussed by Davis. This is true for all 
cases regardless of intellectual level, train- 
ability, age, or physical condition. The first 
section of the complete psychological study is 
a dynamic psychodiagnostic history, based on 
careful analysis of the case history and all 
pertinent material available. Although such a 
task is laborious and time consuming, some as- 
pects or other of this psychodiagnostic history 
are very important in establishing the diag- 
nosis of mental deficiency or in making an eval- 
uation of types of training and care to be of- 
fered. 


A second feature of the master report, which 
in the past has not been given the attention it 
merits, is a complete description of all the pre- 
vious psychological studies of the child. Anal- 
ysis is made of any differences between in- 
tellectual levels found for possible determina- 
tion of losses in functional capacity or allevia- 
tion of emotional disturbances. In addition, 
any evidences of changes in the behavior or 
personality picture of the subject are carefully 
evaluated. Such analyses have aided in the de- 
tection of several cases of pseudo-feebleminded- 
ness. 


The report continues with a detailed ac- 
count of the present psychological study. At 
Southbury the following tests are used wher- 
ever applicable: Revised Stanford-Binet, 
Wechsler-Bellevue, Wechsler Intelligence 
Scale for Children, Kuhlmann-Binet, Minne- 


sota Preschool, Merrill-Palmer, Goodenough 
Draw-a-Man, Grace Arthur, Vineland Social 
Maturity, Rorschach, Thematic Apperception 
Test, Symonds Picture Story, Szondi, Figure 
Drawing, Bender Gestalt, and a variety of in- 
dividual and group achievement tests. Since 
considerable emphasis has already been placed 
upon a knowledge and interpretation of the 
case history and the previous psychological ex- 
aminations, the results of carefully conducted 
psychometric, personality, and achievement 
tests can be considered to be valid indices of 
the individual’s intellectual level. In addition 
to these standardized procedures, emphasis is 
placed upon interview with the child, since 
much information concerning the defective’s 
personality, desires, aspirations, needs, and 
general adjustment can be elicited with proper 
interviewing techniques. 

A further, but apparently neglected, area of 
information for diagnostic and prognostic 
purposes is the longer term observations made 
of the child by the many other institutional de- 
partments. Therefore, a dynamic evaluation of 
other departments’ observations constitutes the 
fourth section of the clinical psychologist’s re- 
port. 

The final and probably most important sec- 
tion of the psychological report deals with 
recommendations and prognosis. It can readily 
be seen that recommendations by the psycholo- 
gist for proper cottage placement, for most 
suitable training or educational program, for 
placement back into the community, and for 
prevention of prognosticated difficulties involve 
not only a thoroughgoing knowledge of the 
child but also a complete perspective and eval- 
uation of the entire institution in all of its 
physical and functional manifestations. In or- 
der to make the recommendation for assign- 
ment toa cottage, for example, the psychologist 
must know the other children within that cot- 
tage and also the program and personalities of 
cottage parents therein, or for recommenda- 
tions for training programs around the institu- 
tion the psychologist must know the types of 
work done in each training unit, the other 
children in the same assignments, the person- 
alities and capabilities of the personnel in 
charge, and also the needs of the institution 
for maintenance of its various services. Thus, 
in offering various recommendations in the best 
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interests of the mentally handicapped child and 
of the training school, the psychologist must 
take into account and evaluate the many 
sources of information. 

The prognosis for the child follows from 
the above described complete knowledge and 
integrated study. The master psychological re- 
port ends with the establishment of the classifi- 
cation and diagnosis of the individual. It has 
been found over a period of time that this com- 
plete psychological study has led to more ac- 
curate diagnoses and prognoses and also has 
given the entire institution staff a more ade- 
quate understanding of the defective. Conse- 
quently, the care and training of the defective 
for the purpose of his eventual placement back 
into society has become much more adequate 
and satisfactory. 


Other Aspects. Similar procedures for child 
study are followed when the children in resi- 
dence are re-evaluated at periodic intervals 
and when requests have been made for their 
placement back into the community. The psy- 
chodiagnostic history now includes a brief 
summary of the child’s general adjustment, 
training, behavior, and progress during the 
period of institutionalization. Again, there 
is a similar workup whenever the clinical psy- 
chologist is requested by the superintendent 
or_other administrative officers to make a spe- 
cific study in response to inquiries from other 
institutions, courts, schools, social welfare 
agencies, physicians, or parents. 

Whenever a child returns to the training 
school from any absence except regularly 
granted visits, a notification is submitted to 
the Director of Psychological Service, who 
then makes a similar study with respect to 
absence and return, formulating recommen- 
dations in areas where necessary. 


BEHAVIOR CLINIC 


Institutionalized defectives constitute only 
about ten per cent of the total defective pop- 
ulation. This indicates that most of those 
who are institutionalized, particularly among 
the high-grade and borderline defectives, have 
been removed from their homes and commun- 
ities for reasons other than low intellectual 
endowment. In some cases the factors lead- 
ing to admission are inherent in the environ- 
ment—inadequate homes, lack of special edu- 


cational facilities, etc.—but more often they 
lie in the realm of emotional, behavioral, and 
social difficulties. Since such factors are not 
altered by institutionalization alone, the Be- 
havior Clinic was established at Southbury 
to deal psychotherapeutically with those who 
present conduct, personality, or social adjust- 
ment problems within the training school. 


The Behavior Clinic is a feature of the 
Child Study Committee and is under the di- 
rection of the clinical psychologist. Briefly, 
the clinic functions as follows: whenever a 
behavior or adjustment problem is noted in 
the cottage, in the school, in the training unit, 
etc., the department head concerned sends 
the psychologist a report covering the specific 
reason for referral to the clinic and any fac- 
tors which he believes have contributed to the 
dificulty. In addition to receiving referrals 
from other departments, the clinical psycholo- 
gist has made it a policy to allow the children 
to come voluntarily to the clinic with any 
problems that they themselves wish to discuss. 
The psychologist handles each case, initiating 
a study, instituting therapy, making recom- 
mendations to other departments, as he deems 
wise. In all Behavior Clinic work the psy- 
chologist has the full cooperation of all per- 
sonnel in gathering information and carrying 
out recommendations. The clinical psycholo- 
gist reports to the Child Study Committee 
any information on Behavior Clinic cases 
which may lead to more widespread under- 
standing of children, awareness of problems 
which do not result in easily recognizable be- 
havior and conduct disturbances, better 
handling of problems, and possible preven- 
tion of other problems. A slow change is tak- 
ing place in the cottage, classroom, and rec- 
reation staffs so that they now are providing 
outlets for the repressed hostility and aggres- 
sion of the child and are making available 
adequate means for the child to show his 
needs for acceptance, affection, security, and 
leadership. 


Thorne [7], in a two-year study on coun- 
seling and psychotherapy with mental defec- 
tives at the Brandon State School, found a 
marked improvement both in the general 
morale of the whole institution and in the 
individual welfare of the children. He con- 
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cluded that counseling with mental defect- 
ives is practical and that the magnitude of 
the problem rendered it desirable that an ex- 
tensive program of research be undertaken to 
exploit the possibilities of a new philosophy of 
case handling. The need for such research is 
so self-evident that it need hardly be under- 
scored here; it should be noted, however, 
that this provides an example of how service 
and research can be combined most effec- 
tively to lead to both immediate results and 
far-reaching conclusions. 


In general, therapy in the Behavior Clinic 
takes the form of situational therapy, individ- 
ual psychotherapy, or group psychotherapy. 
Approximately fifty per cent of the cases seen 
are maladjustments due to the child’s specific 
situation rather than to any deep-seated per- 
sonality or behavioral deviations. In situa- 
tional therapy, the clinical psychologist makes 
recommendations for changes in a child’s 
cottage or training assignment or in his in- 
terpersonal relationships with personnel, other 
children, or his family. The remaining half 
of the cases involve active individual therapy 
with the child who may be insecure, unstable, 
frustrated, lacking in emotional control, or 
lacking in insight into standards for accept- 
able conduct. In all cases where the problem 
appears to be deep-seated and not amenable 
to psychotherapy within an institution geared 
for the training of mental defectives, the 
case is referred to the medical director for 
disposition. Group psychotherapy sessions 
have been conducted with problem children 
and the results have been entirely encourag- 
ing. Cotzin [1] has shown that correction 
and improvement of personality and of social 
adjustment in the mentally defective is feas- 
ible through group psychotherapy, which not 
only allows the child some freedom to express 
his aggression or hostility but also gives him 
the opportunity to relate himself to others in 
a concrete situation. In addition, the thera- 
pist himself can achieve a more adequate di- 
agnosis or insight into the various problems, 
and the leads obtained through group psy- 
chotherapy provide valuable information on 
types of individual psychotherapy most efh- 
cacious with defectives. 


OUTPATIENT CLINIC 


The Outpatient Clinic, which is under the 
direction of the clinical psychologist, has been 
in operation since the opening of the South- 
bury Training School. In recent years its 
services have been augmented in the scope of 
activities and in the number of cases handled. 
The clinical psychologist is responsible for 
scheduling appointments, obtaining case _his- 
tories, interviewing parents and social work- 
ers, seeking medical consultations, and ad- 
ministering pertinent psychological tests. Com- 
plete reports of the study, which may have in- 
cluded a neurological examination by the 
medical director, and covering letters are pre- 
pared for parties interested in the case. The 
referring agencies cover a wide area of the 
western half of the State of Connecticut, and 
a partial list of the sources of referral is: pri- 
vate and public social welfare agencies, State 
Department of Health, Visiting Nurse Asso- 
ciations, Juvenile Court, Public School De- 
partments, other institutions and _ hospitals, 
town selectmen, physicians, judges, and fami- 
ly members. 

Because of the lack of adequate staff facili- 
ties, the primary emphasis in the Outpatient 
Clinic has been on diagnosis rather than on 
therapy. A variety of problems has been pre- 
sented for diagnostic purposes: question of 
mental deficiency, educational disability, pri- 
mary behavior problems, personality disor- 
ders, foster home placement, vocational guid- 
ance for retarded individuals in the com- 
munity, and other problems of maladjust- 
ment either in the school, family, or neighbor- 
hood. 

Plans are under way for the construction of 
larger quarters for the Outpatient Clinic to 
meet more adequately the demands for out- 
patient work and to enable more therapy. 
This clinic will remain under the executive 
direction of the clinical psychologist and will 
have on its staff a part-time psychiatrist, a 
psychiatric social worker, a medical steno- 
grapher, and several psychologists. As is true 
in his other service activities, the role of the 
clinical psychologist in the outpatient work 
at Southbury is again far removed from that 
of the traditional psychometrician. 
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PSYCHOLOGICAL RESEARCH PROGRAM 


Present day care, training, and under- 
standing of mental defectives has been en- 
hanced by research activity in this field. The 
records at the Southbury Training School are 
a treasure house of source material which is 
proving helpful in providing an authentic 
foundation for the study of mental deficiency 
and of the practice of its training program. 
In these records, which may all too often be 
neglected, are to be found the test of theories 


both as to causative factors and care and 
training. 


Because of his basic training, the psychol- 
ogist is particularly well equipped to organize, 
plan, and conduct research on problems in 
mental deficiency. The research programs at 
Southbury are oriented to the needs of the 
institutional situation. The topics are essen- 
tially those involved in the psychologist’s serv- 
ice activities and are geared toward increas- 
ing the scope of these activities. 


Many institutions for mental defectives, 
including the Southbury Training School, 
overlook one of their important assets when 
they include on their staffs a clinical psychol- 
ogist with research training and then indi- 
rectly require his full-time activity in clinical 
services. The importance of his experimental 
training to the future welfare and growth 
of the institution is masked. Psychologists in 
institutions should be given the opportunity 
of demonstrating their total clinical compe- 
tence by being allowed sufficient time and pro- 
fessional assistance to carry out a research 
program. Here the clinical psychologist must 
institute carefully controlled conditions so 
that his results are accepted and utilized by 
administrators; but first and foremost, the 
psychologist must not be forced to devote his 
own free time to conducting research. More 
adequate research facilities at the present 
time would undoubtedly save precious hours 
of future clinical activity and of future care 
and training problems. 


PSYCHOLOGICAL CONSULTANT AND 
EDUCATIONAL SERVICES 
As is implied in the above discussions, the 


clinical psychologist serves as an active con- 
sultant to the other departments on all mat- 


ters dealing with an understanding of the 
varied problems of care and training of in- 
stitutionalized defectives. He spends time in 
conference with the staff and with parents 
and visitors. Throughout there is a give-and- 
take relationship between knowledge of clini- 
cal psychology and the practical needs and re- 


quirements of administering a large institu- 
tion. 


The practical work involved in the daily 
operation of an institution frequently pre- 
cludes the assimilation of the techniques and 
ideas developed in the research laboratories of 
the colleges and universities. In its efforts to 
spread further psychological knowledge and 
experience throughout the entire institution, 
the Department of Psychological Service in- 
stituted an Annual Summer Colloquium in 
1947. The immediate purpose of this collo- 
quium was to acquaint the personnel of the 
training school with current trends and new 
ideas developed in other institutions and in 
the laboratories of nearby universities and 
colleges. At the same time it served as an 
opportunity for the training school personnel 
to formulate and present for discussion the 
practical problems which confronted them in 
their daily work. Psychology’s Annual Sum- 
mer Colloquium has become a permanent fea- 
ture of the training school calendar. 


An intern training program has been es- 
tablished, and Southbury has been designated 
as a training center for graduate students in 
the clinical programs at Yale University and 
the University of Connecticut. The trainee 
receives instruction and experience in all of 
the functions for which the Psychology De- 
partment is responsible. In addition, psychol- 
ogy classes from nearby universities and 
teachers colleges attend lectures at Southbury 
as part of their course work. Finally, the 
clinical psychologist is called upon to address 
various lay or allied professional gatherings 
on topics in clinical psychology. 

As a member of the training school’s ad- 
ministrative staff, the Director of Psycho- 
logical Service participates in the superin- 
tendent’s staff meetings where all matters 
pertaining to the business, functioning, and 
policies of the institution are discussed. 


Clinical psychologists, as do laymen, have 





8 MILTON COTZIN 


the opinion that the mental defective is an 
uninteresting, uncomplicated, and dull indi- 
vidual who would present no problems of in- 
terest to them professionally, and that insti- 
tutions for mental defectives offer little op- 
portunity for utilization of their clinical and 
research skills. This paper has attempted to 
show that the mental defective is psychologi- 
cally as challenging as any other individual, 
and that the varied role of the clinical psy- 
chologist in an institution for defectives can 
be most stimulating and satisfying. 


Received April 1, 1950. 
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HANDEDNESS IN CEREBRAL PALSIED CHILDREN’ 


EUGENE E. DOLL anp MABELLE S. WALKER? 


M. STUART WALKER CLINIC SCHOOL, PHILADELPHIA 


HE present study was undertaken to de- 
termine the handedness of thirty-four 
children, with a view to utilizing the 

results in clinical diagnosis and in a thera- 
peutic educational program. It was carried out 
as a project of a small private school* which 
is designed primarily to meet the needs of the 
cerebral palsied but which also accepts a limited 
number of speech cases stemming from other 
causes. In practice this school has attracted an 
unusually high percentage of pupils suffering 
from aphasia, withdrawal, and expressive men- 
tal and motor retardation. Its clinical and ed- 
ucational programs are therefore concerned, 
first, to differentiate between inherent and ex- 
pressive retardation, and second, to develop 
fully the latent potential of the expressively re- 
tarded. 


PROBLEM AND PURPOSE 


One of us, Director of this school, has long 
been interested in the educational implications 
of disturbed handedness, having early achieved 
success with a number of cases of speech dis- 
order and expressive retardation by dealing 
therapeutically with disturbed dominance. ‘The 
work with the cerebral palsied made the ques- 
tion an increasingly urgent one, as the recog- 


1The term “cerebral palsy” is here loosely used 
to designate developmental nervous or motor im- 
pairment caused by intracranial lesion. In all but 
one of the children here classified as cerebral pal- 
sied the lesion is presumed to be paranatal in ori- 
gin. 
2Miss Walker has been responsible for the con- 
ception and general supervision of the laterality 
testing program as well as for the educational im- 
plementation. Doll bears the major responsibility 
for the techniques of administration and scoring, 
the accumulation of data, and the writing of the 
present paper. The authors bear joint responsibil- 
ity for the classification and conclusions presented. 
Acknowledgment is made to Edgar A. Doll for 
critical and editorial suggestions. 

3Now known as the M. Stuart Walker Clinic 
School, City Line Ave., Philadelphia, Pa. 


nition or choice of a dominant hand for train- 
ing posed an immediate question in many in- 
stances. It was suspected, moreover, that a 
problem of unresolved dominance was often 
present where it was not obviously urgent, and 
that this condition might be a consideration of 
major educational importance, especially in 
dealing with aphasia and other forms of ex- 
pressive retardation. 


Anyone familiar with the extensive writ- 
ing on laterality in the last fifteen years must 
be well aware that the relationship of handed- 
ness to speech and other expressive and intel- 
lectual functions is highly controversial. We 
have been less interested in the theoretical as- 
pects of the problem than in the development 
of a diagnostic instrument which could aid in 


the planning and developing of experimental 
educational techniques. 


In spite of the widespread disagreement in hand- 
edness studies, several of the most serious and ex- 
perienced workers have agreed in suggesting a 
positive relationship between disturbed dominance 
and speech disorders. Orton [2, p. 13] early em- 
phasized the unilateral physiological localization of 
both speech and manual dexterity and warned 
against the possible consequences of “failure in es- 
tablishment of the normal physiological habit of 
using exclusively those [engrams] of one hemi- 
sphere” [1, p. 126]. After a series of very careful 
studies on both children and adults he reached the 
conclusion [2, pp. 64-65] that confusion in handed- 
ness was likely to be associated with speech disor- 
ders if it occurred at “critical periods” in the de- 
velopment of linguistic skills. He suggested [2, pp. 
143-144] the advisability of special training for the 
hand of “greater capacity,” although warning that 
laterality is but one of many factors and that no 
educational procedure can be indiscriminately ap- 
plied to all comers. Van Riper [4] in his tests of 
central tendency found the performance of speech 
defectives similar to that of a selected group of 
ambidexters and in sharp contrast to that of his 
two unilateral groups. 


Weisenberg and McBride [5], dealing specifically 
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with the relationship between cerebral lesion and 
aphasia, concluded [p. 435]: “While some change 
in mental functioning probably comes with every 
cerebral lesion, the presence of aphasia almost al- 
ways requires a lesion of the dominant hemisphere 
as indicated by handedness.” They found [p. 452] 
the dominance indicated by handedness “a criterion 
of the crucial hemisphere for speech in about ninety- 
five per cent of the cases.’”* 

Phelps [3] working orthopedically with the cere- 
bral palsied, found mental development, emotional 
behavior, and speech relatively normal in hemi- 
plegias of the non-dominant side but found emo- 
tional instability, convulsive seizures, and disturb- 
ances in speech and intellectual function more fre- 
quent among hemiplegias of the dominant side. In 
treatment he advocated the carrying through of 
spontaneous shifts and the establishment of a new 
dominance, noting that an incomplete shift may 
cause expressive retardation. He also suggested 
that ambidexterity may at times be the result of 
undetected hemiplegia. 


One of us (Walker) had meanwhile noted 
that the development of strong unilateral 
dominance in individual pupils was associated 
with marked advances in both educational ap- 
titude and emotional stability. The carrying 
forward of her program of training in later- 
ality demanded some more refined instrument 
than gross observation and uncontrolled ex- 
perimentation. Although a number of good 
handedness tests were already in existence, 
none was suitable for use with cerebral palsied 
children. Performance tests emphasizing speed, 
accuracy, and strength tended to yield not the 
dominant hand but the “better” hand. Ques- 
tionnaires included many items beyond the life- 
experience of the majority of these children. 
Consequently, a new experimental scale was 
drawn up, adapted to the needs and interests 
of the children and placing less emphasis upon 
precision and refinement of performance. 

The present paper is a description of the ap- 
plication of this test to thirty-four children 
during the academic year 1947-1948. As the 
study was made in connection with the educa- 
tional program of the School, two feeble- 
minded children and one cerebral palsied adult 
were also included for comparative purposes. 
At our present stage of knowledge the data of 
behavior are too complex to lend themselves to 
refined analysis. We have therefore contented 


“They also noted [5, p. 453] that the non-domi- 
nant hemisphere is “apparently concerned with 
normal language function,” but “to a limited de- 


gree.” 


ourselves with descriptive summation and for 
the time being have avoided specific statements 
of causation, prognostication, and correlation. 


SUBJECTS 


The 34 subjects ranged in age from 4.0 to 
19.5 years, age being taken from the nearest 
half year. They were distributed as follows: 
4 subjects at age 0.0 to 5.0 years, 12 at 5.5 to 
8.0 years, and 18 at 8.5 to 19.5 years. These 
subjects displayed the following disabilities: 
18 birth injured (orthopedic diagnosis), 5 pre- 
sumptively birth injured, 1 post-encephalitic, 
2 mongoloid, 1 feebleminded (generic), 3 cleft 
palate, 4 unclassified. The post-encephalitic 
and one mongoloid subject were complicated 
by presumptive birth injury. 

Most of these subjects were rejections from 
public-school systems, a number of them re- 
jected even from special classes and private 
schools. A high percentage were considered in- 
stitutional types incapable of learning. Twen- 
ty-six were presumed to be mentally deficient ; 
only seven were considered actually or poten- 
tially normal mentally. 

On the basis of examinations at the School 
the presumption of mental deficiency was re- 
jected in 13 of the 26 subjects. In seven, the 
presumption of mental deficiency was ques- 
tioned, and in each of these was definitely es- 
tablished as of less degree than had been or- 
iginally presumed. In six, the classification of 
mentally deficient was retained, but the de- 
ficiency again considered as of less degree than 
had been originally presumed. One subject sent 
to the school as potentially normal was re- 
classified as probably mentally deficient. 

In each instance where the mental estimate 
was raised, it was raised on the basis of some 
finding in the fields of handedness, speech, 
hearing, or vision. However, because of other 
complicating factors (such as motor disability 
or delayed educational opportunity) a prog- 
nosis of “good” was rendered for only 15 of 
the 34 subjects, “fair” for 14, “poor” for 5. 
These prognoses are to be construed in terms 
of ultimate social independence; it is hoped 
that a good proportion of those with prog- 
nosis of “fair” may become at least partially 
self-supporting. 

Specially pertinent to the question of hand- 
edness is the motor ability of the subjects under 
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consideration. With so high a percentage of 
birth injury, there is naturally also a high in- 
cidence of motor disability. Fifteen of the sub- 
jects were either receiving physical therapy or 
were wearing corrective devices. It is of the 
greatest importance, however, to note that in 
twelve instances the motor damage was so 
slight as to be evident only to the keen observer, 
the alert clinician, or the trained orthopedist 
or neurologist. The oldest subject in the study 
had matured in the days when adequate physio- 
therapeutic treatment was even less generally 
available than today; he would probably have 
received such treatment had he been born ten 
years later. Seven of the subjects showed no 
observable motor involvement, except for the 
gross motor characteristics of the feebleminded 
subjects and the influence of a corrected club- 
foot in one subject. 

Practically all these children suffered from 
language disabilities. “Twenty-eight suffered 
from severe speech handicaps (either lacking 
in effective communication or, if communicat- 
ing, lacking 25 to 80 per cent of the conson- 
from 
moderate speech handicaps (lacking 25 per 


ants in context), while four suffered 
cent of the consonants in context). ‘Ttwenty- 
seven suffered from severe reading handicaps 
(no word recognition except through constant 
drill) ; one suffered from a moderate reading 
handicap (retention of drilled words and fair 
a) 4 ” c 

word-getting”’ of new words). 

CONTENT AND 


ADMINISTRATION OF TESTING 


It was early felt that disturbance or con- 
fusion in handedness could cause a considerable 
disturbance of the intellectual processes and 
that a more refined study of the handedness of 
individual children was essential to an effective 
program of reading and writing. Consequently, 
it was decided to draw up a standard handed- 
ness test system which would yield a mensur- 
able record of responses under relatively con- 
trolled situations. 


This schema as finally administered con- 
sists of a series of twenty-nine test items® in- 
volving performance with one or both hands, 
calling for finger and arm movements in 
varying degrees. All involve actual perform- 

5An additional test (Item 30) was later added, 


but data for this item were not obtained for these 
34 subjects. 


ance with material objects. The items were 
groupea in a roughly genetic sequence for 
purposes of administration and interpretation. 
All but two items are administered in this 
genetic sequence; these two are consistently 
displaced for purposes of social rapport. The 
items range from gross undirected movement 
at the lower end of the scale to four involving 
refined directed movement at the upper end. 
One item 
three are influenced by teaching if the subject 


is conditioned by social custom; 
has progressed that far in the educative process. 
Two are purposely structured to present an 
ambivalent field favoring performance with 
both hands. In one item performance is inter 
rupted in ‘course to see whether it will be re- 
sumed with the same hand. For comparative 
and interpretative purposes one item testing 
eyedness is included. ‘The items of the scale are 
as follows: 


1. Shaking rattle 16. Crumbing 
2. Shaking noise 17. Cutting 
maker 18. Winding toy 


3. Reaching for tissue 19. Bursting bag 


4. Pushing tumble toy 2 Hammering toy 


5. Feeling fuzzy 21 Marking or writing 
pictures 22. Painting 
6. Throwing into 23. Erasing 
basket 24. Dropping feathered 
7. Shaking hands darts 
+ Fitting blocks ? Flipping game 
into holes 26. Spearing candy 
9. Swatting 27. Fitting tacks into 
10. Holding tube 
11. Stacking 28. Using toy telephone 
12. Sipping through 9 I'ving bow 


a straw 10. Sighting into 
13 Leafing book 


14. Sighting into tube 


kaleidose ope 


15. Pointing 


Scores are recorded during the examination 
on a large form which provides ample space 
for recording the number of times each hand 
is used in significant movement, for indicating 
the general sequence of behavior, and for not 
ing any special observations. This form also 
provides space for recording the history of 
from 
parents, teachers, or other informants), ortho 


handedness (insofar as it is available 
pedic data, data on familial handedness, mis- 
cellaneous remarks, and interpretative summa- 
tion. 


are condensed on 5 by 8 forms, which provide 


Following the examination these data 


a concise picture of performance on the vari- 
ous items, accompanied by any necessary ex- 
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planatory remarks. From this chart the essen- 
tial performance on each item is determined 
and a percentage of total essential perform- 
ance calculated. Finally a profile of perform- 
ance on the twenty-nine items is drawn on the 
5 by 8 card. 


Usually the notes on history, family, and 
disabilities are taken after the administration 
of the scale rather than before. This enables 
the examiner to come to the individual with- 
out preconceptions, and throws him upon his 
mettle to seek all relevant factors. He thus 
formulates one or more hypothetical interpre- 
tations as he proceeds; these are checked and 
revised when the historical, orthopedic, and 
familial factors become definitely known. It is 
preferable that the subject should not know 
the purpose of the test—although, in practice, 
even those who do know the purpose usually 
become absorbed in the performance. With 
the subjects here reported the examiner made 
consistent attempts to maintain a fairly high 
degree of social rapport, that performance 
might be as spontaneous as possible. About 
half of the items are demonstrated by 
the examiner, demonstrations being performed 
alternately with the left and right hands. Spe- 
cial care is taken to present all materials on a 
perpendicular or horizontal axis in the mid- 
line. 

The examiner must be constantly on the 
alert for the many factors which may influence 
handedness. The subject must, of course, be 
comfortably seated at a table of proper height. 
He must also be placed at ease socially, as far 
as possible, and his attention must be sustained. 
All of these conditions present special prob- 
lems with the cerebral palsied. The problem 
of height is of special importance, as it will 
sometimes be found that a given subject pre- 
fers one hand for performance at one height, 
the other at another. In four of these tests a 
lap board which could be raised or lowered at 
will was used in place of a table—and in one 
case, especially, it proved possible almost to in- 
duce alternation of the hands by raising or 
lowering the board. 

On the demonstrated items the examiner 
must be alert to pick up mimicry, either direct 
or crossed. Indeed, on all items he must take 
great care not to influence performance in one 
way or another, or if he inadvertently does so, 


to make note of it. The subject must always be 
free to initiate the first move without precon- 
ditioning (except on the two structured 
items). For example, on the item “shaking 
hands” the examiner will say, “Let’s shake 
hands,” and wait to see which hand the child 
presents. It is important that neither hand be 
occupied, or in a poor position, when the item 
is presented. Yet the subject must not be con- 
stantly harassed in this respect. Ofttimes an ex- 
planatory note will suffice, such as, “The left 
hand was on top,” this spontaneous position of 
rest being in itself of significance. Especially 
with the cerebral palsied the examiner must 
note whether performance is clumsy or skilled, 
initial or final, primary or secondary. He must 
be on guard for reversals,* for one of the 
chief problems in disestablished handedness 
among the cerebral palsied is whether the 
shift is to be attributed to physical handicap 
or to other genetic or environmental influences. 
While the orthopedic and historical data will 
be pertinent here, they are not always reliable 
or complete; it is therefore desirable to have 
them independently confirmed by the handed- 
ness test, if for no other reason than to make 
“assurance doubly sure.” 


SCORING THE TESTS 


In the initial scoring seven possibilities of 
behavior are considered, indicated by the fol- 
lowing symbols—R, L, B, E, RL, LR, and C. 
R indicates performarice with the right hand 
alone, L with the left hand alone. B indicates 
performance with both hands simultaneously, 
E (either) with both hands consecutively rath- 
er than simultaneously. RL indicates a shift 
in performance from right to left, LR a shift 
from left to right. C (confused) indicates 
triple or quadruple shifts, a rapid succession of 
repetitive single shifts, such shifts as BL, RB, 
or any exotic behavior not covered by the 
other symbols. Such behavior is indicated as 
precisely as possible on the sheet for raw scores 
and subsequently summarized as C for pur- 
poses of the handedness “profile.” 

In scoring, shifts are construed as relating to 
a unit of performance in the specific activity 
tested by an individual item. Shifts in which 


®By reversals is meant the reversal of pattern, as 
in writing, screwing, and so on, which occurs in 
true genetic left-handedness. 
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the subject reaches with one hand and trans- 
fers to the other for actual performance are 
separately indicated and are distinguished from 
shifts made in the course of such performance. 
In practice, this distinction is often difficult to 
make. In items consisting of a number of unit 
tasks the various units are counted—so that a 
final score might be given as 5R, 11L, 2RL, 
1LR, 1B. For profile purposes this performance 
would be considered essentially E“ (either, but 
left favored). 


The determination of essential performance 
for percentage and profile purposes cannot 
easily be reduced to a rigorous methodology. 
Here, for many items simple mensuration will 
not be applicable, and one must determine by 
inspection of the score, by remembered observa- 
tion of performance, and by reasoning, which 
symbol best describes the performance. The 
skillful and alert examiner will, however, find 
that his field of observation has been delimited 
and purified, so that his evaluation is now 
based upon a controlled situation. While the 
determination of essential performance is not 
based upon a strictly quantitative method, it 
is freed from many of the extraneous influ- 
ences which would color subjective judgment 
outside of a test situation. Actually, essential 
performance is usually pretty clearly indicated 
from the record, especially if the judgment be 
made with reference to the total picture and if 
all details have been carefully observed. This 
determination of essential performance is used 
only for purposes of determining percentage 
and profile; it in no way precludes the use of 
the original scores in the final evaluation of re- 
sults. Indeed, one must almost always turn 
back to the full scores in establishing final in- 
terpretation. 


Once the points of essential determination 
have been established on the columns of the 
summary card, they are connected by a con- 
tinuous line to give what is then called the 
handedness profile. This indicates at a glance 
the subject’s performance on any or all items 
and graphically portrays the unified pattern of 
the unilateral individual, the swings and in- 
consistencies of the confused, as well as the 
degrees of the intermediate stages. The points 
of essential performance are then again used to 
calculate a total score of essential performance. 
For purposes of this total, which aims ulti- 


mately to indicate the percentage of activity 
with the preferred hand, B (both) and E 
(either) scores are thrown together ; this unity 
is then again broken up in terms of B® and 
BY". B® indicates both hands used (cither sim- 
ultaneously or consecutively) but the right 
more than the left; B” both hands used, 
but the left more than the right. A ratio is ob- 
tained by dividing the number of items (usual- 
ly 29, but occasionally it is impossible to ob- 
tain a score on all items) into the greatest 
number of unilateral essential performances. 
Thus, a total score of R11, £4, B4, B*2, B"2, 
C5, yields the ratio R .39: i.e., 39 per cent of 
the tested activity of this subject is essentially 
right handed, and this is the highest percentage 
of activity performed by either hand alone. It 
is at once clear, however, that in some of the 
bilateral activity the right hand is more active 
or more effective than the left. Consequently a 
second ratio is calculated, this time using the 
B® score as the dividend, and the final score 
is expressed as R .39 + .17. (This, incidental- 
ly, is the lowest unilateral score yielded by any 
child tested.) This score indicates that the 
right hand is used more than the left, 39 per 
cent of the activity is performed by the right 
hand, and an additional 17 per cent is per- 
formed bilaterally but with the right hand 
contributing more than the left. ‘The remain- 
ing 44 per cent of this subject’s performance 
was by the left hand, by both hands with the 
left predominant, or by both hands used in such 
a way that neither seemed to predominate. 


INTERPRETATION AND CLASSIFICATION 


These scores prepare one for the final prob- 
lems of classification, diagnosis, and recom- 
mendation. Especially with the cerebral pal- 
sied these are exceedingly complex and diffi- 
cult. Added to the variables of heredity, par- 
ental influence, and education is an element of 
physical damage which is difficult to describe in 
terms of degree and which may affect either or 
both sides in an endless variety of proportions. 
Often the physical damage is so slight as to be 
evident only under the most painstaking or- 
thopedic or neurological examination; yet it 
may be sufficient to set in motion a spontaneous 
shift which may or may not be completely car- 
ried through, or which may reduce the individ- 
ual to astate of confusion by precluding the es- 
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tablishment of either dominance. Behavior is 
based upon the threefold impulse of genetic 
bent, spontaneous accommodation, and outside 
interference. A person may perform with one 
hand at a given time because it is “natural” to 
do so, because that hand is easier to use in 
terms of physical handicap, or because he has 
been told to use it. To these considerations 
must be added the other factors discussed 
above under administration—such as mimicry, 
accident, height, structure of the situation, at- 
tention, and fatigue. With young children one 
must further remember Gesell’s findings with 
respect to the maturation of handedness. 

In the face of all these complications the 
present schema offers no easy short cut to clas- 
sification and diagnosis. It does not offer any 
magical clue to genetic handedness nor does it 
determine an educational program. It does of- 
fer a considerable refinement of the simple 
observation and unorganized testing upon 
which many clinicians have hitherto relied. 
Tasks of given variety are presented under con- 
trolled circumstances ; sequence, characteristics, 
and predominance of behavior are noted and 
tabulated; mensurable quantitative elements 
are introduced. By thus ordering and refining 
gross data the test offers new insight into the 
problem of the individual child. It confirms or 
throws open to question the intuition of the 
educator, while it adds to the orthopedic find- 
ings the perspective of a wide range of actual 
performance. When interpreted in the light 
of familial, historical, and orthopedic data it 
leads to possibilities of classification which are 
based upon careful and controlled study rather 
than superficial observation. In our work at 
the School it has proven of clinical value in 
presenting an objective analysis and in offering 
a sound and convincing basis for educational 
planning. By clarifying the picture it has fre- 
quently contradicted or led to a revision of par- 
ental statements with respect to early behavior. 
It has also proven useful in reconciling parents 
and teachers to proposed changes in handed- 
ness. In three instances it has actually led to a 
revision of the original clinical impression and, 
hence, the proposed educational program. 

In our work we have been led to recognize 
seven essential types of handedness: natural, 
enforced, disestablished, reéstablished, trans- 
ferred, mixed, and confused. 


In natural handedness the native bent has been 
consistently maintained in the development of the 
individual. 

In enforced handedness one hand is so badly 
handicapped that the individual has actually no 
choice but to use the other, regardless of hereditary 
tendency. An individual with enforced handed- 
ness may be actually following his natural bent or 
he may be using the genetically secondary hand. It 
is frequently difficult to tell whether hereditary or 
traumatic factors dictate the use of one hand. In 
either instance performance is essentially the same 
—consistent performance without confusion or 
anomaly. 

In disestablished handedness a hereditary tend- 
ency to perform with one hand is apparent, but the 
individual has been urged to use the other hand, 
either because of injury to the dominant hand or 
because of some personal or educational interven- 
tion. Hence, the individual has abandoned his na- 
tive dominance but without establishing the oppo- 
site dominance. Such a disestablishment may be 
either spontaneous or induced, transitory or chronic. 

In reéstablished handedness an individual has 
been reéeducated in the use of his native dominance 
and has returned to his native preference. 

In transferred handedness the subject has def- 
initely abandoned the native tendency in favor of 
the secondary hand. Such a transfer may be either 
spontaneously or educationally effected. In most in- 
stances of transfer the percentage of performance 
with the dominant hand is as high as in the reés- 
tablished cases. It is interesting to note, however, 
that the transferred cases exhibit more educational 
disabilities than do the reéstablished. In short, the 
transfer may be successfully accomplished as such, 
but problems of integration tend to remain. Many 
disestablished cases are attempts at transfer which 
have been arrested for one reason or another. 

Mixed handedness occurs in cerebral palsied chil- 
dren who, by the nature of their handicap, are 
forced to use one hand for some activities, the 
other for others. 

Finally, we may classify as confused handedness 
those cases in which no native tendency is apparent 
to the examiner. This is frankly a wastebasket 
classification—and frequently it may be the ex- 
aminer rather than the child who is confused! This 
class includes those cases where native tendency 
and traumatic disestablishment are so evenly bal- 
anced that native tendency has never become mani- 
fest; it also includes the theoretically possible cases 
of central ambivalence. In practice. we have gen- 
erally sought to avoid this classification, using it in 
only three of the thirty-four cases. 


In assigning a given subject to any one of 
these classes the examiner must, again, rely 
more upon his native canniness than upon hard 
and fast rules of interpretation. He has, how- 
ever, as noted above, orderly data upon which 
to base his conclusions. Although it is often 
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difficult to assign a given individual with com- 
plete satisfaction to one class or another, our 
diagnoses at the School show gratifying con- 
sistency in terms of percentage scores of per- 
formance. Unfortunately, however, one can- 
not go directly from percentage to classifica- 
tion, for each percentage range is common to 
two or three classes. The natural and enforced 
yield scores ranging from (R or L) .79 to .93; 
the left-handed individuals score somewhat 
lower than the right-handed because social ex- 
perience has encouraged a degree of ambidex- 
terity in them. Only one transferred showed a 
score within this range (R .86).7 With this 
one exception the reéstablished and the trans- 
ferred range from .69 to .77, clustering about 
.75. The disestablished, mixed, and confused 
range from .31 to .66, with most scores in the 
.40’s, .50’s, and low .60’s. In other words, the 
individuals for whom handedness constitutes 
an unresolved problem can be readily recog- 
nized on the basis of percentage scores. Fur- 
ther, the subjects for whom a conflict has been 
resolved can be distinguished, in every case but 
one, from those who never were in conflict. 


DISCUSSION 


Throughout the course of the study it was 
hoped that items would emerge which would 
definitely and typically point to one hand or 
the other as the “birthright” hand, the hand 
of natural preference. In this we were severely 
disappointed. A few general tendencies with 
respect to the individual items did, however, 
emerge. It was at first thought that the genet- 
ically prior items might tend to call forth re- 
version to the birthright hand; that in such 
items, where training is presumably at a mini- 
mum, the primitive preference of the individual 
would be found unadulterated. For readily ap- 
parent reasons, however, just the reverse 
proved true; these early items are particularly 
unstable and unreliable in diagnosis. The very 
simplicity of such items as “shaking a rattle,” 
“reaching for a tissue,” “feeling fuzzy pic- 
tures,” and “throwing into the basket” is such 
that they are easily performed with either 
hand ; even natural and enforced subjects will, 


7This score may have been affected by continual 
practice in beating time with one hand; this ac- 
tivity was imposed almost daily over a long period 
of time in the interest of effecting a complete trans- 
fer. 


if circumstances so dictate, perform them 
readily with the secondary hand. How much 
more the disestablished! 


Interestingly enough, insofar as a tendency may 
be noted, reversion appears to be most common at 
the opposite end of the scale, where activity is 
most refined, minute, and complex. It is there, 
when the subject finds himself in difficulty and 
finally baffled or frustrated, that he at last aban- 
dons his “good” substitute hand to return to his 
less able birthright hand, apparently falling back 
helplessly upon the deeply entrenched native tend- 
ency, with arrogant disregard for the reality of 
the physical handicap. When the subject finally 
feels himself “pushed to the wall” he turns blindly 
to the birthright hand for rescue. Consequently, 
Item 27, “fitting tacks into tube,” the most refined 
of all our items, has proven the most likely, taken 
alone, to call forth reversion. also 
common in “bursting the bag” (where, however, 
there is frequent embarrassment in scoring), and 
in “sighting.” It is also at 
“winding” and “cutting.” 


Reversion is 


times apparent in 

Certain other items, while not indicating which 
hand is genetically dominant, dramatically indi- 
cate the confusion of the disestablished individual. 
Item 2 in the scale was purposely structured to 
present an ambivalent situation, while in Item 11 
the objects are rearranged at the midpoint of per- 
formance to present ambivalence. Four other items 
(5, 8, 15, and 24) and Item 11 in its initial stage 
are apparently in themselves ambivalent to the dis- 
established and usually to the reéstablished and 
the transferred. These items can be depended 
upon, usually individually, always in concert, to 
indicate that confusion either is present or existed 
at a previous time. They are especially interest- 
ing in providing “historical perspective” in indi- 
viduals otherwise well established, whose earlier 
difficulties might not be apparent from their per- 
formance on other items. 

Leaving the individual items, one finds another 
clue to interpretation in the number and nature of 
shifts in the course of performance. Shifts are at 
a minimum among reéstablished subjects; they are 
somewhat more common, but still few in number, 
among the matural and the enforced. They are 
still more common among the transferred and six 
times more common among the disestablished than 
among the transferred. Moreover, among the trans- 
ferred subjects, shifts from the birthright hand to 
the substitute hand predominate, while among the 
typical disestablished subjects, shifts from the sub- 
stitute to the birthright predominate in the ratio of 
two to one. 


In other words, as an individual succeeds in 
establishing a new dominance, the shifts from sub- 
stitute to birthright seem to decrease markedly, 
while the shifts from birthright to substitute seem 
to remain in relatively greater proportion. We 
have, however, a number of atypical and compli- 
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cated disestablished subjects for whom this direc- 
tional tendency does not seem to hold; further re- 
search along this line will be necessary before a 
positive statement can be made. At present, it 
appears to us that the disestablished individual 
tends to shift most frequently from the substitute 
hand to the birthright hand and to prefer the 
birthright hand on difficult items involving refined 
movement, 

After careful weighing of the many factors 
discussed in the course of this paper, our 34 
subjects were classified as follows: Natural 2, 
Enforced 6, Reéstablished 2, Transferred 5, 
Disestablished 12, Mixed 2, Confused 3, Un- 
classified 2. From this it is clear that the major- 
ity of these subjects were either disestablished 
at the time of the test or had at some earlier 
time gone through a period of disestablishment. 
In most instances we were able clearly to deter- 
mine the genetic handedness and the direction 
of the shift. 

EDUCATIONAL PLANNING 


Educational planning is a still more difficult 
problem than classification or diagnosis and 
must often proceed on an experimental basis. 
In general, it may be said that a child should 
be returned to his native dominance unless in- 
jury has handicapped that side. When the in- 
jury is on the dominant side, the child should 
be encouraged to carry through the shift. The 
great task is to lead the child to accept one 
hand or the other. Our School encourages free 
discussion of handedness with the child. It also 
includes in the curriculum activities which em- 
phasize the predominance of one hand, teach 
proper codrdination of the two hands, or teach 
rhythmic or continuous progression in one di- 
rection. Particularly useful in this respect have 
been typing (codrdination) ; pottery-making, 
beating time, coloring, finger-painting, and 
pulling sand (emphasis on one hand) ; cursive 
writing and dancing (progression in one direc- 
tion). 

Our experience has been that speech and 
other educative processes receive definite for- 
ward impetus when the disestablishment in 
handedness is resolved by either reéstablish- 
ment or transfer. We have found that the con- 
fused and the disestablished types progress 
only when the child definitely “accepts” one 
hand as dominant. This acceptance must come 
from the child, who may receive guidance in 
this respect but cannot be forced. Our data on 


this educational problem are too complex to 
be presented in this paper. For the present the 
following summary of educational progress 
must suffice. 

The two subjects classed as natural presented no 
major educational problems once the mechanical 
difficulties which interfered with speech were amel- 
iorated by special training in speech. The two re- 
éstablished subjects, both originally diagnosed as 
not educable, and both disestablished when accepted 
for training, have made excellent educational prog- 
ress since the reéstablishment. Both have overcome 
speech and reading disabilities. The five subjects 
classified as transferred (three of them transferred 
since admission) have made good educational 
progress, but show, as a group, a distinctly lower 
aptitude in reading (an average of 3.2 as opposed 
to 1, on a five-point scale). The disestablished and 
the confused show, in comparison, marked educa- 
tional handicaps; all but three suffer from distinct 
linguistic handicaps of non-motor origin. Indeed, 
the only one of the disestablished subjects to make 
excellent educational progress is atypical in the 
group. She had originally the second highest per- 
centage of unilateral activity in the group; she has 
established a definite dominance since the adminis- 
tration of the test. This child has had three years of 
special muscle training in the hands and has worked 
for two years on the typewriter. She was not per- 
mitted to begin writing until the handedness diff- 
culty had been overcome. Similarly, in the con- 
fused group, the best progress has been made by 
the child with the highest percentage of unilateral 
activity. 

Curiously enough, the cases classified as enforced 
have made a poorer educational showing than have 
the mixed. This we are at a loss to explain unless 
other factors be operative of which we are not 
aware. It might be observed that all but two of 
the enforced subjects were denied educational op- 
portunity until a relatively late age. One of these 
suffers from an exceedingly severe physical handi- 
cap; the other is the highest of the group scholasti- 
cally, with an educational average equal to that of 
the transferred group. The two children of mixed 
dominance, on the other hand, have had good edu- 
cational instruction from early childhood. It is 
possible that, with the emphasis placed upon sided- 
ness at the School, they have resolved their con- 
flict in some deeper fashion unkown to us at pres- 
ent. 

Our experience, we believe, indicates clearly 
that handedness is a factor of deep-seated im- 
portance in the education of the cerebral pal- 
sied child, and one which can, in most instances, 
be resolved by critical diagnosis and special 
training. We would, of course, be the first to 
admit that it is but one of many factors in the 
complex problem of the education of the cereb- 


ral palsied. 
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SAMPLE SUMMATIONS 


A. Female, age 4.0. First test. R .36 plus .11 

S is one of the most confused children tested, 
showing an approximately equal division of ac- 
tivity between the two hands, shifting on all am- 
bivalent items and on some simple ones. Her con- 
fusion follows no set pattern, although in general 
she prefers the L for simple and difficult tasks, R 


for the intermediate. Eye preference, unclear, 
seems to be L. She does not typically shift on difh- 
cult items. The most reasonable interpretation 


seems to be of a native L-handedness in a state of 

partial transfer through training or handicap. Dif- 

ficulty in unscrewing also suggests this. S 

no apparent handicap with either hand. 
Type: Disestablished ? 


shows 


B. Same subject, two months later. R .31 plus .17 


S’s handedness now appears even more ambiv- 
at the time of her first test. She now 
performs an even smaller proportion of her activ- 
ity with the R hand alone than previously; her 
ambidexterous performance has increased. How- 
ever, her total percentage of R-handed activity is 
now larger. 


alent than 


Her shifts, which were formerly pre- 
dominately RL, are now equally divided between 
LR and RL. She also shows a slight increase in 
R-handedness on the more difficult items. These 
observations suggest that she has progressed some- 
what in a spontaneous shift from L to R. The leg 
injury on the L reinforces this hypothesis, as does 
her leafing the book from back to front. 
Disestablished 


C. Female, age 5.5. R 46 plus .04 


Type: 


§ shows an approximately equal division of ac- 
tivity between R- and L-handedness. She uses the 
R hand for all activities involving training and 
social pressure, reverts to the L in untrained and 
difficult situations. There is little confusion be- 
tween the two hands, but the training toward R 
dominance has not successfully overcome the native 
L tendency. The eye is L. There is some tendency 
toward ambidexterity. The mother admits that the 


child was born L-handed, trained to use the R. 
Type: Disestablished 
D. Male, age 9.5. R .86 plus .03 
§ shows consistent preference for the R hand in 
all activities but more division of activity between 
the two hands than is R-handed 
This all native L_ tendency 
which has successfully shifted to the R be- 
cause of either brain injury or training. 


usual is a indi- 


vidual. suggests a 


been 


Type: Transferred 
E. Female, age 5.5. L .50 plus .07 
§ is a rather badly handicapped child who be- 


came exhausted during the examination but 


insisted upon continuing. She refined 
movements with the R, with 
the L. This corresponds with the observations of 
the orthopedist that the fingers are better on the R, 
the shoulder on the L. Those activities performed 
with the L are such as could call the deltoid mus- 
cle into play. The more frequent use of the L 
preference for it in 


performs 


grosser movements 


suggests a ambivalent situa- 


tions, therefore possible L natural preference. This 
corresponds with the use of the L eye. 


Type: Mixed 
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INDUCING FRUSTRATION IN ADULT SUBJECTS 


GARDNER LINDZEY ann HENRY W. RIECKEN 


HARVARD UNIVERSITY 


HIS paper will describe a technique for 
inducing frustration experimentally in 
relatively sophisticated adult subjects, 

evaluate the results of the technique as em- 
ployed by the authors, and consider some im- 
plications of their findings. 


As part of a broader study [4] the authors 
had to devise a situation capable of inducing a 
state of intense frustration in sophisticated 
adult subjects of college age. The results of a 
comprehensive review of the literature on ex- 
perimentally-produced frustration were disap- 
pointing. No single, adequately-reported frus- 
tration technique appeared to be feasible and at 
the same time capable of producing the desired 
effects in our relatively mature subjects, al- 
though many of the techniques reported for 
lower animals and for children seemed to have 
been highly satisfactory. For the most part, ex- 
periments employing adults consisted of at- 
tempts to assault the subjects physically or 
physiologically in laboratory situations where 
the subjects could be reasonably sure no real 
harm would come to them [3, 5, 7] or else 
depended on interference with a goal response 
that had been artificially established in the 
laboratory situation and could not be expected 
to have very strong instigation [1, 2, 6, 8]. 
Relatively little emphasis was placed upon 
frustration of the social motives or acquired 
drives that seem so important in the customary 
frustrations that most individuals encounter in 
everyday living. A further, and in some re- 
spects more serious, shortcoming of most of the 
previously-reported studies was that, in almost 
all cases, it was the experimenter rather than 
the subject who designated the situation as 
frustrating or stressful. 

Taking into consideration the findings of the 
studies reviewed, the present investigators 
agreed upon ten criteria to aid them in devising 
a situation that would produce feelings of frus- 
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tration in young adult subjects. We agreed 
that an adequate frustration situation ought 
to: 


1) Frustrate multiple needs or motives rather 
than a single need. This would lessen the likeli- 
hood that subjects would be unaffected by the ex- 
perience simply because of chronic or acute reduc- 
tion of the single need that had been chosen for 
frustration in the experiment; 

2) Bring into operation social motives center- 
ing about sensitivity to the attitudes of other peo- 
ple by embedding the frustration experience in a 
group situation; 

3) Link the members of the group functionally 
in such a way that failure on the part of the ex- 
perimental subject would leave him vulnerable not 
only to contempt for inferior performance but also 
to actual hostility for having interfered with the 
achievement of a goal that was important to the 
remaining members of the group; 

4) Make the success or failure of the experi- 
mental subject appear to depend upon his own ef- 
forts so that he could not readily blame others 
for an unsuccessful outcome; 

5) Involve the subject seriously and make it 
extremely difficult for him to be detached, or to treat 
the situation as a game or sport; 

6) Employ a task that could be made meaning- 
ful or important to the subject and yet be suffi- 
ciently tedious or difficult to be boring or frustrat- 
ing in itself; 

7) Make the subject’s failure immediately ap- 
parent to him rather than dependent upon an inter- 
pretive act by the experimenter, such as announc- 
ing a score or presenting norms; 

8) Make possible concealment of the investi- 
gator’s intent to frustrate the subject; 

9) Have a reasonable amount of constancy and 
comparability of conditions from subject te subject 
and yet permit flexibility in the event of an emer- 
gency or of a subject who deviates markedly from 
other subjects; 

10) Inhibit very strongly any behavior that 
might serve to release tension or reduce hostility 
in the situation. 


The character of any experimental situation 
depends largely upon the specific interests of 
the experimenter. Nevertheless, we feel that 
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the foregoing “ideal” criteria possess con- 
siderable generality, and would be useful in 
designing a large variety of specific “frustra- 
tion”’ situations. 


After describing the frustration technique 
employed in the present investigation, we shall 
evaluate its success and then consider briefly its 
implication for frustration research. 


FRUSTRATION TECHNIQUE 


As is true of most frustration studies, it was 
vital that the real purpose of this investigation 
be concealed from the subjects. Mr. A., the 
experimenter who had originally seen the 
twenty subjects and administered a number of 
scales designed to measure aggressive tendency, 
effected concealment by indicating that he was 
interested in standardizing his “personality” 
measures for group administration. He told 
his subjects that another member of his de- 
partment, Mr. B., who was working with 
small groups, had volunteered to give some of 
the same “personality” scales to his groups. In 
return for this, Mr. B. had requested that the 


first investigator induce some of his subjects to - 


participate in the small-group experiment. The 
subjects were told rather vaguely that Mr. 
B.’s group experiments were concerned with 
“cooperativeness” and that they were being 
conducted by a former physiological psycholo- 
gist who, because of his earlier training, had 
introduced certain physiological measures into 
the experiment. These measures would neces- 
sitate the subjects’ going without food from 
breakfast until the experiment was completed 
in the evening. Subjects were also told that 
there was some sort of reward being offered 
for successful completion of the experiment. 
An appointment was made for an evening ap- 
proximately two months after the initial con- 
tact. 


Two months later, upon arrival at the place 
of appointment the subject was greeted by Mr. 
B., who first took the subject’s blood pressure 
and then attempted to secure a blood sample, 
using a spring lancet that had been set to 
achieve maximum pain without permanent in- 
jury. The subject was given a quart beaker 
filled with mildly flavored water and urged to 
drink all he could so that Mr. B. could per- 
form a particular kind of urinalysis. He also 
asked the subject not to urinate until the ex- 


periment had been completed, when a urine 
sample would be collected. 

The subject was then taken to the experi- 
mental room and introduced to three other 
“subjects,” two young men and an attractive 
young lady. These three individuals were all 
undergraduates, like the subject, and appeared 
to have the same role in the proceedings as he 
did. Not only did their behavior, their remarks, 
and their demeanor suggest this, but there 
were also deliberate cues such as alcohol and 
blood-soaked bits of cotton in front of them 
to strengthen the impression. In fact, however, 
these three undergraduates were confederates 
of Experimenter B., as was the fifth “subject” 
introduced later on. 

Mr. B. then left the room “to get the last 
subject.” During the next ten minutes the sub- 
ject could and customarily did establish posi- 
tive relationships with the accomplices, thus be- 
coming more sensitive to their feelings toward 
him. 

Mr. B. then returned with the final “‘sub- 
ject,” another attractive girl, and got the 
group experiment under way. He said he was 
interested in studying cooperativeness in a 
group situation and certain physiological cor- 
relates of this behavior. The task of the sub- 
jects would be to sort a pack of cards according 
to rules that he would supply later. Card 
sorting, Mr. B. pointed out, was not a meaning- 
less task but, on the contrary, closely related 
to general intelligence. 

A final point of Mr. B.’s talk had to do 
with reward. He offered a reward of five dol- 
lars to each subject, provided that all the mem- 
bers of the group were able, on any one trial, to 
sort all the cards within the time limit and 
without error. Mr. B. emphasized the fact 
that the reward was offered not for individual 
excellence but only for a perfect group trial. 
He also pointed out that more than two- 
thirds of the groups that had been tested had 
won the reward. 


Next, each subject was given seventy-five 
small file cards, on which had been printed 
various combinations of symbols. Two sets of 
complex rules for sorting the cards were given 
the subject, which he was to use alternately 
on the sorting trials. 


Mr. B. gave the rather complex instructions 
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rapidly and rather casually, concluding with a 
warning that both speed and accuracy were im- 
portant. A fair number of the experimental 
subjects asked questions about the instructions, 
and the experimenter replied to these with a 
condescendingly patient repetition of the orig- 
inal language. 

At the word “Go,” all the subjects began to 
sort the cards, and, after a variable amount of 
time depending upon how rapidly the experi- 
mental subject sorted, they were ordered to 
stop. The experimental subject was always 
least far advanced in the sorting task at the 
end of the first trial. The speed of sorting of 
the accomplices was artificially controlled by 
Mr. B. through signals. The actual accuracy 
of confederates’ sorting was unimportant 
since the experimenter controlled the error 
count and could thus produce any accuracy 
score he desired after the sorting on any trial 
had been finished. At the completion of each 
trial, after counting the errors of each subject, 
the experimenter posted the 12sults conspicu- 
ously on a large blackboard in full view of all 
the subjects. The performance of each subject 
was identified by his name written next to it. 

In all, seven trials were run under these reg- 
ulated conditions, and it was possible to ap- 
proximate very closely the “ideal pattern” of 
scores that is reproduced in Table 1. 


TABLE 1 
TYPICAL PERFORMANCE ON CARD SortTinc Task 





1-1 1-2 2-1 2-2 3-1 3-2 41 


P-1 P-3 P-0 P-0 P-0 P-0 P-0 





Mr. Accomplice 


Mr. Subject F F F F P-3 F P-2 
Miss Confederate F F P-1 P-2 P-0 P-1 P-0 
Miss Shill P-3 F P-1 F P-0 P-0 P-0 
Mr. Plant P-2 P-—4+ P-0 P-1 P-0 P-0 P-0 





F = failed to finish within time limit 

P = finished within time limit 

1, 2, 3 = number of errors made on trial finished 
within time limit. 


It can be seen from this table that the gen- 
eral pattern was for the experimental subject 
to begin poorly and to improve his scores grad- 
ually but much more slowly than the accom- 
plices did. From the beginning it seemed prob- 
able that the subject would fail. Most im- 
portant, he actually was responsible for pre- 
venting the group from receiving the reward 
on two occasions, the fifth and seventh trials, 
and was almost responsible again, on the sixth 


trial, when all but one of the accomplices 
finished in time with a perfect score. Following 
the sixth trial the subjects were given a rest 
pause with an interpolated activity. After 
this, Mr. B. announced that the final trial, the 
last opportunity to win the reward, would be 
on the simpler of the two tasks. He encouraged 
the group by telling them they had come very 
close and could win the reward this time if 
they tried hard. 


Mr. B. commiserated with the group over 
their failure and then asked all the subjects to 
fill out a brief questionnaire concerning their 
reactions to the experiment. The experimental 
subject was then turned over to Mr. A., who 
had earlier made arrangements to meet him at 
this time. 


EVALUATION OF FRUSTRATION TECHNIQUE 


In the following discussion we shall con- 
sider three major questions: (1) how well did 
the frustration situation we employed meet the 
“ideal criteria’; (2) to what extent did the 
subject experience the situation as frustrating; 
(3) which aspects of the situation were most 
efficacious in producing feelings of frustration? 


Meeting the Ideal Requirements for a Frus- 
tration Situation. From the foregoing descrip- 
tion it is evident that the technique employed in 
this study successfully fulfilled all but one of 
the criteria stated earlier. The single exception 
was the requirement that the subject be im- 
mediately aware of his failure and not have to 
rely upon some report from the experimenter. 
This requirement was met on all trials where 
the subject failed to finish the task (roughly 
75 per cent of the trials). Only in those cases 
where the subject finished his task and his 
failure depended upon errors determined by 
the experimenter was this requirement not met. 

The Extent of Frustration. The experi- 
menters had at their disposal six indices of 
frustration, each of which will be discussed 
separately, in terms of the evidence it provides 
concerning the reaction of the subjects. 

1. Immediately following the frustration 
experience the two experimenters made inde- 
pendent ratings of the subject’s behavior. The 
rating scale consisted of a single over-all dis- 
turbance item with five descriptive categories 
ranging from: “Apparently completely un- 
touched by the experiment” to “ Very much 
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upset emotionally, gave evidence of difficulty 
in inhibiting inappropriate responses.” ‘The 
mean rating for the entire group fell midway 
between the two following descriptive state- 
ments: “Was noticeably disturbed, but was 
well controlled at all times” and “Disturbed, 
ill at ease during much of the experiment.” 
The range included all categories except the 
lowest. Thus, the two raters seem to have 
agreed that none of the subjects came through 
the experience completely undisturbed in overt 
behavior and, further, that the average indi- 
vidual in the group was appreciably disturbed. 
It is important to remember that the frustra- 
tion situation was so designed that the subjects 
faced strong sanctions against actually releas- 
ing tension or displaying overt disturbance 
during the experiment. 

2. Immediately following the frustration 
situation each subject filled out a very brief 
questionnaire including the following ques- 
tion: “In general, how do you feel about the 
experiment? (Just one or two sentences of 
general reaction).” All twenty of the subjects 
included in their responses some reference to 
emotional disturbance or at least frustration of 
some desired goal. All but three of these refer- 
ences bore directly upon the subjects’ feelings 
of inferiority over poor performance, guilt over 
having let the group down, or hostility over 
being subjected to this experience. 

3. An informal interview was conducted 
during dinner shortly after the frustration sit- 
uation. Ten of the twenty subjects spontane- 
ously commented that they had failed in the 
experiment, most of them elaborating to indi- 
cate the enormity of their failure and their 
consequent guilt and disturbance. The re- 
maining ten subjects commented on the situa- 
tion and announced their failure in response to 
a nondirective question only indirectly related 
to the frustration experiment. All but one in- 
dicated that they were disturbed, upset, guilty, 
or sorry about the outcome of the experiment. 

4. From two weeks to a month after the 
frustration experience an_ electrically-trans- 
scribed interview was conducted during which 
the experimenter attempted to get as much in- 
formation as possible concerning how the sub- 
ject felt during the frustration situation. Al- 
though no elaborate content analysis was con- 
ducted, it is significant that all but one subject 


made remarks implying hostility toward some 
part of the frustration situation. This informa- 
tion together with the other material bearing 
upon the subjective reaction to the frustration 
was assembled, and the subjects were rank- 
ordered in terms of the degree of subjective 
frustration that they experienced. The follow- 
ing are excerpts from the protocols of the in- 
dividuals who were most and least frustrated: 


Most subjectively frustrated. “ . . . the tension 
and pressure of the group experiment . .. . the 
first time around I failed it. . . .I didn’t make it the 
second time, the fact that she [Miss Confederate] 
improved and I didn’t . . . of course, all the 
others by this time were bettering their scores while 
I was not finishing. . . . I didn’t do well at all, 
and after the first or second time I knew I wasn’t go- 
ing to do well . . . I felt—I couldn’t seem to con- 
centrate fully on what I was doing, I'd call it 
my fault, because I would not allow myself to 
fully concentrate on exactly what the test was... . 
I was mad, of course, at myself: I certainly wanted 
to make that goal as much as anybody else, and 
I was mad that I was allowing myself to feel that 
way .... and as far as the five dollars was con- 
cerned, I didn’t give a darn about it, uh—I would 
just as soon have passed the experiment and have 
everyone else get it and not me. . I just wanted 
to make it so that everyone else could get it... 
emotionally that’s what bothered me they 
were very quiet — but I could feel tension... I 
can feel those things, and I could—well they were 
a good bunch (other subjects) and uh I was hop- 
ing it wasn’t coloring their—although that was the 
only thing they had to go on. . 
blame them for thinking that 
had the feeling when I left the room that some- 
thing was unfinished; that—uh—for that obvious 
reason that the people didn’t know me; and that 
was the only impression they’d get of me — I'd 
certainly like to let them know that... I guess 
I appeared to be ignorant, and they thought I was; 
. . . Some people can get along—they have no con- 
science; they don’t give a darn what people think; 
well, I do... and that is probably the thing that 
bothers me most. I felt in the middle of the ex- 
periment like saying: ‘Look, I have this trouble; 
I don’t want to foul things up any longer. Why 
don’t you just forget me.’ But, of course, I didn’t 
say that .. .” 


. and I couldn't 


darn well, but, I 


Least subjectively frustrated. “Well, I of course, 
wondered what he was up to, and also felt dis- 
tress at not being able to make the same grade 
that the rest of them did, and I felt pretty rushed 
all the time I was in the room there . . . every- 
body else seemed to be making a good score on 
the tests, and I couldn’t—I think I finished the 
test only twice . . . and even in that score, I still 
had several errors . . . everybody else was either 
finishing, or else if they didn’t finish they didn’t 
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have any errors ... and I think that tended to 
make me more nervous... the lasc time everybody 
else had a perfect score except myself, and I was 
the downfall of the group . .. it wasn’t too un- 
pleasant as much as it was disturbing . . . yeah 
... I felt like crawling under the table... . ” 


5. At the conclusion of the study eight sub- 
jects provided written reports describing in de- 
tail their feelings during the experimental 
frustration situation. In all cases but one, these 
reports were written after the subjects had 
been informed of the deception practiced upon 
them. Only one of these eight reported feelings 
that might be considered removed or detached 
during the experiment, and, even in this case, 
exception might be taken to the subject’s claim 
if we examine his remarks on the evening of 
the experiment. 

The following excerpts are from the single 
report that was filled out prior to the subject's 
knowledge of the deception and then supple- 
mented by another report after the disclosure. 
They indicate the rather intense frustration 
of the subject, who was one of the most severely 
frustrated of the group: 


“ 


. . « I alone was responsible for the failure of 
my group to achieve the incentive I had 
great difficulty in focusing my mind on the cards 
and deciding in which pile I should place them 

. my nervous tension increased greatly as I real- 
ized that I might be responsible for the group 
failure to achieve the incentive. This reached such 
proportions toward the end of the test, that it be- 
came one of the principal factors making for my 
bad performance. The extreme nervousness led to 
an increase in the blurred quality of my mind de- 
scribed above. . . . I believe the failure to dis- 
tribute the incentive of five dollars a person is 
without justification. Since no intrinsic value in 
the test may be seen, and since money was appro- 
priated for payment of these subjects, I see no 
justification in withholding the incentive. I feel 
particularly guilty over having caused the four other 
members of my group to have lost the incentive 
and believe that if anyone is to forfeit payment, it 
should be myself and not the others. . . . [From 
the report after disclosure] . . . I think that the 
effects of the . . . test were above all frustrating. 
I think I was more frustrated in those several 
hours than in any others in my life.” 


6. The Rosenzweig Picture-Frustration 
Test and the Thematic Apperception Test had 
been administered to all subjects several months 
before they participated in the experiment. On 
a retest immediately following the frustrating 
situation, the total group of subjects showed 


significantly more extrapunitive responses for 
both instruments than they had upon initial 
testing. Even without assuming the frustration- 
aggression hypothesis, one sees from this finding 
that the experimental situation did produce 
significant normal behavior. 
More striking than this are the qualitative dif- 
ferences, which cannot be summarized here, be- 


alterations in 


tween the two administrations of the TAT 
cards. 

Relative Efficacy of Various Elements in 
the Frustration Situation. The twelve- to fif- 
teen-hour food deprivation was extremely vari- 
able in its effect upon subjects. About one- 
quarter of the subjects indicated little or no 
concern over going without food this length of 
time. A little more than one-quarter appeared 
drastically affected by the fast and complained 
of headaches and loss of strength or of motor 
ability. The remaining subjects found the ab- 
stinence disagreeable but did not seem to be 
greatly upset by it. The failure to achieve the 
five-dollar reward for himself was mentioned 
as frustrating by only two or three of the sub- 
jects. On the other hand, failure to perform as 
well at the assigned task as did the other mem- 
bers of the group seemed to disturb most of the 
subjects and in some cases was the cause of a 
great deal of ego-defensive behavior. Prevent- 
ing the other members of the group from 
receiving the reward offered seemed to be ex- 
perienced uniformly as a strong source of frus- 
tration. ‘There were a great many responses 
that indicated that the subject would not have 
minded the situation at all if only he had not 
kept the others from the reward. Another 
measure of the sensitivity of the group to this 
aspect of the situation is the frequency with 
which Mr. B. was criticized for his unfairness 
in keeping the other members of the group 
from the reward. 


A crude ranking of the extent to which the 
different aspects of the situation effectively 
frustrated the subjects would place the prevent- 
ing of the other members of the group from re- 
ceiving the reward, at the top of the list and 
well ahead of any of the other elements. Next 
would come failure to do as well as other mem- 
bers of the group, and then, respectively, food 
deprivation, failure to achieve reward for self, 
and urine retention. 
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SUBJECTS’ REACTION TO DISCLOSURE OF 
DECEPTION 

Important considerations in any frustration 
experiment are the degree of rapport main- 
tained with the subjects and the extent to 
which the experimenter eventually reveals any 
deceptions that he has practiced. In the present 
study, excellent rapport was maintained with 
all the subjects throughout the study. All ex- 
perimental deceptions were revealed at the end 
of the study. The characteristic response to 
this complete disclosure was strongly positive. 
A great many of the subjects seemed delighted 
by the idea of the deception, and a number 
made remarks indicating that they were deeply 
indebted to the experimenter for having per- 
mitted them to participate in the study. This 
positive response may be partially accounted 
for by the fact that discovering they had not ac- 
tually failed and let down the other partici- 
pants in the removed a considerable 
amount of guilt and felt inadequacy. Beyond 
this, however, the subjects seemed to be re- 
sponding positively to the fact that they had 
received a great deal of personal attention from 
staff members. 


study 


SUMMARY AND CONCLUSIONS 

In the foregoing report we have attempted to 
describe and evaluate a technique for frustrat- 
ing reasonably sophisticated adult subjects in a 
laboratory situation and to present some in- 
dices used to measure the extent to which sub- 
jects “experience” a given situation as frus- 
trating. The results of this study indicate that: 

1. It is possible to frustrate adult subjects 
effectively in a laboratory situation. 


2. The most effective “agents” of frustra- 
tion appear to be those that block acquired or 
socially-important motives rather than those 
that block organic or primary drives. 

3. It is possible to estimate roughly the de 
gree to which a given experience is actually 
frustrating for individual subjects. 


Received March 24, 1950. 
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PATIENTS VIEW THE THERAPIST: A TRAINING 
AND RESEARCH DEVICE 


ABRAHAM 5S. LUCHINS 


MCGILL UNIVERSITY 


NE of the procedures employed in 
training psychotherapists consists of 
having the supervising or control 

therapist discuss with the trainee the happen- 
ings of one or more of the latter’s sessions with 
a patient. The supervisor may make statements 
concerning the patient-therapist relationship 
and the effects he believes the trainee-therapist 
is having on the patient. The trainee may have 
his own views concerning the effects he is 
having on the patient and the relationship be- 
tween them; and his conceptions may or may 
not coincide with the supervisor’s. Unfortu- 
nately, neither the supervisor nor the trainee 
generally has direct evidence on which to base 
his judgments. One difficulty, it seems to us, is 
that the patient is not consulted. 

The present report deals with an attempt to 
obtain directly patients’ reactions to trainee- 
therapists and the latters’ reactions to the pa- 
tients. It is based on the assumption that one 
can gain from the patient an understanding of 
how he perceives the therapist and the thera- 
peutic situation. We shall describe the pro- 
cedures employed, some of the results they 
yielded, and some of their implications for 
therapy, training, and research. 


PROCEDURES 


To date, the procedures to be described were 
utilized with three groups of patients in an 
out-patient mental hygiene clinic. All patients 
were males between 19 and 39 years of age 
and diagnosed as psychotic; all trainees were 
clinical internes participating in a training 
program in group psychotherapy; the writer 
was the permanent leader of each of the three 
groups. The sessions, each about two hours in 
length, were held three times weekly for two 
groups and five times weekly for the other 
group, for a period of about six months. Three 
trainees were assigned to each of the former and 
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five trainees to the latter group. Since each 
interne was requested to attend on a stipulated 
day of the week, it was customary for one in- 
terne to be present during each session. 

While one aspect of the internes’ task was 
to serve as participating observers and keep 
notes on the group sessions, they were encour- 
aged to act as co-leaders or to assume the lead- 
ership of the group. If the trainee showed signs 
of taking over the group, the permanent 
leader assumed the role of participating ob- 
server. When the leader had to absent himself 
from a session, the trainee of the day took 
charge of the group. In the presence of the pa- 
tients the internes were treated as regular staff 
psychologists who were serving as co-leaders of 
the group and were therefore generally ad- 
dressed by us with the title of doctor. 

After the groups had been in session about 
three months, we attempted to obtain the pa- 
tients’ impressions of the trainees. In order to 
make certain that they correctly identified the 
trainees, we first asked them to write (or tell 
us, if the questioning was conducted in an in- 
dividual session) the names of all the “leaders” 
of their group therapy program, other than 
ourselves, and to indicate after each the day of 
the week that the particular “doctor” was 
present at the meetings. No patient experienced 
difficulty with this assignment. Then the vari- 
ous questions concerning the internes were pre- 
sented. Only after the patients had indicated 
that they had finished answering one question, 
was the next one introduced. In attempting to 
ensure comprehension, we found it necessary 
to rephrase the questions for some patients, 
but changes from the forms to be cited were 
introduced cautiously in order to avoid suggest- 
ing answers. 

1. Please write [or tell me] what you think 


about each of the doctors. What kind of a person 
is... {mame of doctor]? 
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2. What do you think each of the doctors thinks 
of you, that is, what kind of a person does he 
think yen are? 

3. What do you think each of the doctors is 
trying to do? Consider this as a sort of stage. 
What role is each trying to play? 

4. What role does each doctor think you are 
playing? What does he think you are trying to do? 

5. What role would you like to have him play? 
What do you want to have him do? 

6. What role are you really playing? What are 
you trying to do? 


a 


7. List the names of the doctors in order from 
(a) those whom you like the most to those whom 
you like the least, (b) those who like you the most 
to those who like you the least, (c) those who un- 
derstand you best to those who understand you 
least, and (d) those who sympathize most with you 
to those who sympathize least. [Each ranking task 
was assigned separately. ] 


Similar questions were asked of the co- 
leaders, who were requested to write their re- 
sponses and submit them to us. Each was asked 
to give his impression of every patient in the 
group, as well as what he thought the pa- 
tient thought of him. He was asked to de- 
scribe the role (or roles) that he was at- 
tempting to play in the group sessions, the 
role (or roles) each patient thought that 
he was playing, and the role each wanted 
him to play. He was also asked to rank 
the patients with reference to the manner in 
which (a) they liked him, (b) he liked them, 
(c) he understood them, and (d) he sympa- 
thized with them. To explain the assignment 
the internes were told that they were partici- 
pating in a study on forming impressions of 
personality. As a matter of fact, we do intend 
to use most of the obtained data for that pur- 
pose. It is hoped to derive some interesting ob- 
servations on impressions of personality from a 
careful analysis of the relationship between 
the patient’s reactions to a trainee and the 
trainee’s reactions to him. 

In the two groups which met thrice weekly 
the patients were interviewed individually by 
the writer, and all responses were recorded. In 
the third group the questions were asked 
during one of the sessions and the patients were 
requested to write their answers. No internes 
were present during these sessions. Thus, eleven 
patients of one group were questioned (in in- 
dividual sessions) concerning their three co- 
leaders; the ten patients of the second group 
were questioned in like manner concerning 


three other co-leaders; the twelve patients of 
the third group were questioned (during a 
group session) concerning their five co-leaders. 
All in all, eleven trainees and thirty-three 
patients were involved in the study. 


COMMENTS ON METHOD 


Before discussing the findings, we wish to 
deal with two issues which may have occurred 
to the reader. 


Firstly, is there not involved in this pro- 
cedure the danger that the patients may feel 
as if they hold a whip hand over the internes? 
This possibility was minimized in our groups 
since the task of giving impressions of clinical 
personnel, including the permanent group 
leader, was not an unusual one for the patients 
[cf. 3]. The task was introduced and treated 
in a casual manner and no further reference 
made to it in the presence of a patient. It did 
not seem to the writer (or the internes) that 
the questioning left the patients with any spe- 
cial sense of power or privilege in their rela- 
tionship to the co-leaders. 


Secondly, may the patient’s verbalization of 
his reactions to his therapist not harm the 
therapeutic relationship? There is involved 
here the problem of the nature of the relation- 
ship between the therapist and the patient. Must 
the former be regarded as above the ordinary 
run of mortals with whom the patient is in 
contact, and must the relationship between 
them be regarded as one too delicate to stand 
the strain of verbalization? To be very blunt 
about it: patients often talk about their thera- 
pists whether one wills it or not. It is not un- 
heard of, for example, for a patient participat- 
ing in both individual and group therapy, un- 
der different therapists, to discuss one with the 
other, sometimes praising, sometimes condemn- 
ing, often comparing. If the patient would in 
any event verbalize his reactions to the thera- 
pist, there could not be too much harm in- 
volved in asking him to do so. And if the pa- 
tient would not have verbalized his reactions 
to the therapist except for the fact that he was 
directed to do it, then it might be of value to 
request that he do so. We base this statement 
on the following theses: (a) The therapeutic 
relationship is to a large extent an interperson- 
al relationship; (b) insight into his interper- 
sonal relationships may help the patient to 
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achieve more adequate social adjustments and 
may lead to better mental health; (c) system- 
atic verbalization of his reactions to the thera- 
pist may help him to achieve insight into the 
interpersonal relationship involved in the ther- 
apeutic situation. 


RESULTS 


In order to understand our patients’ reac- 
tions, it is important that the reader keep in 
mind that the assigned tasks were not entirely 
unfamiliar to them. One of the features of the 
group psychotherapy program in which they 
were participating involved similar tasks and 
activities [cf. 3]. They had been encouraged 
to focus on the role they and others were play- 
ing in a situation, whether in the clinic or out- 
side of it, and to give their impression (verb- 
ally or by pantomime) of people whom they 
met outside of the clinic, of fellow-patients, 
and of newcomers to the group [3]. More- 
over, they had been encouraged repeatedly to 
give their impression of the permanent leader 
of the group and of the role he was attempting 
to play. 

Nevertheless, not every patient responded 
adequately to the requests. A few gave gibber- 
ish which appeared to have little overt relation 
to the assigned task, while others repeated the 
same phrase for every co-leader of their group. 
In general the patients did not confine them- 
selves to the questions at hand but included 
other information. For example, in their initial- 
ly offered impression of a trainee some patients 
included their conception of the role he played 
(“he’s just a secretary who takes notes”) or of 
their relationship to him (“of all of them, I 
like Dr... . best”). Allin all, about one-half to 
three-quarters of each group did submit im- 
pressions of most of the co-leaders of that 
group. The ranking assignment was particu- 
larly unsuccessful, perhaps because it was the 
first time that the leader had asked the patients 
to rank individuals, or because ranking is a 
fairly complex task involving not only quali- 
tative distinctions but also quantitative ones. 


After the data had been collected from the 
patients and the co-leaders of a group, the lat- 
ter were told that the data had potentialities 
for training purposes. In order to allay any pos- 
sible fears that the material would be used 
against them, the trainees were assured that 


the data would not be used to test or rate them 
or for any administrative purposes. Each trainee 
agreed to permit the other co-leaders of the 
group to read what had been said about him, and 
what he had written, in order to provide a basis 
for comparisons and to make possible a joint 
discussion period. The data were then typed 
so that all the comments concerning one in- 
terne, as submitted by the various patients, 
were together; and all the comments on one 
patient submitted by the various internes were 
together. A copy of all this material was given 
to each of the group’s co-leaders with the in 
structions to read first what the patients had 
written about him and to jot down his reac- 
tions ; then he was to read the remainder and jot 
down his reactions. Subsequently the writer 
held individual conferences with each interne 
during which time the latter was encouraged 
to discuss his reactions to the data and to indi- 
cate what he thought of the data and procedure. 


After the trainee had had the opportunity 
to express his reactions, we raised the following 
problems for his consideration: 


1. Was there anything in the group sessions— 
something you did, something the permanent leader 
did, or something the patients did—which could 
have given rise to or which seemed to support this 
(We some- 
times played records or read notes of sessions which 


patient’s expressed impression of you? 
seemed to have bearing on the expressed impres- 


sion. ) 


2. How can you explain (not explain away) 


similarities and differences between your account 


of your role and a patient’s account of it? Try to 


appeal to what took place in the sessions rather 
than to theoretical concepts. 

3. What do you think can be done to make this 
patient see you as you wish to be seen, to produce 
the effect you wish to produce? 

The individual conferences were followed 
by a joint seminar to which all the co-leaders 
of a group were invited. One such seminar, 
lasting about two hours, seemed to exhaust the 
topic for the co-leaders of one group; those 
of the other groups requested and obtained 


several such discussion periods. 


SAMPLES OF PATIENTS EXPRESSED 
IMPRESSIONS OF TRAINEES 


As an example of the kind of data we ob- 
tained, we are presenting the answers given 
by seven patients of one group to Question | 
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concerning four of their co-leaders. The re 
sponses were written during a group meeting. 
TRAINER A! 


Patient I: My impression of him is a helpful guy 
like an older brother, trying to help a brother that 
strayed on the wrong path. I believe Dr. A likes 
me greatly and I like him the best of all. He has 
sympathy and a very warm understanding from 
within his inner self. 


Patient II: It is hard for me to judge him. I 
think in a way that he was helpful, but no one of 
the psychologists impressed me as being up to you 
[Luchins]. (I believe that you have helped me 
more than any social worker or psychologist I have 
ever known.) 

Patient III friendly, unfortunately a 
philosopher, but he keeps it from showing. He likes 
Dick Tracy and The 


man’s philosopher, You can’t distinguish the psy- 


Human, 


western movies, working- 


chologist from the man. Integrated. Plays no 


“role’—is naturally 
Patient IV: I spoke to him for a brief period of 
time on three or 


interested in the men. 
four occasions. My only impres- 
sion of him is that he’s quite intelligent, and that 
apply “book in treating 
patients but rather a combination of his own ex- 


he does not psychology” 


perience and some “book psychology.” 
Patient V: Inclined to be non-communicative and 
inactive in participation; pleasant group leader. 
Patient VI: Is very self-confident and relaxed in 
the group. He seems to have a very carefree per- 
Seems to ability to 
group going by direct questions and stories, etc. 
Patient VII: The first “guinea-pig’ 
’neath my microscopic lens will be the 


sonality have the 


keep the 
’ to pass 
smiling Dr. 
A. I liked his personality more than all the others 
put together. don’t much 
knows but his personality was al- 


Perhaps I know how 
psychology he 
ways a “psychological” factor whenever we were 
thrown He’s mood 


and he therefore is a good morale booster whether 


together. always in a jovial 
you can appreciate his happy moods or not. His 
theories are still a deep dark secret. But he’s good 
to have around. He’s the kind of guy you would 
like to spend the day with; lets say, fishing, or 
woods-trekking. He looks and behaves like an 
“eagle scout,” the fellow you always like to have 
around. 
TRAINEE B 
Patient I: I think or associate B as a young doc- 
ter trying to comprehend the inner conflicts of hu- 
man beings without too much success. He seems 
incapacitated at times and group conversations 
drop off to silly chatter. I think he is confused 
about me at times, and trys to comprehend how 
could a patient have more understanding in a psy- 
chological problem than a young psychologist. (I 
think I know more than he.) 


Throughout the excerpts we substitute a spe- 
cific letter for the name of an interne and a spe- 
cific Roman numeral for the name of a patient. 


Patient II 
out with a thought idea that I couldn’t express in 
my own words. I felt that he understood my feel- 
ings and felt relieved by his helpful action. That 
when he that I 
thought, that though I haven’t accomplished much 
right now, I will be better than all of the group 
in years to come, when I have finished my educa- 


Impressed only once by helping me 


was last Wednesday, declared 


tion, 

Patient IIT: He likes [Patient IT]. This is almost 
A gentle soul, doesn’t like to hurt 
Should be a shoemaker. 


enough said 
Rather asinine. 
Patient IV: Reminds me of [Therapist D]—less 


cold and conceited, kind but not forceful. 


people, 


Patient V: Quiet, reserved, pleasant student. 
Patient VI: A very quiet, withdrawn individual 
who acts mostly as a secretary 


Patient VII 
attributes for this gentleman. 


Nice guy and sundry conventional 


But he leaves much 


to be desired as far as influencing me with his 


therapy. Too soft spoken and too cagy and austere 
as to going on record, He reminds you of a poli- 


tician who calls a press conference intimating 


world shocking issues were to be given a “going- 
over.” Then, when he gets through with his pre- 
pared statement, he turns to the reporters and re- 
gretfully announces: “Gentlemen, of course you 
know everything that has been said here is strictly 
off the record and I wouldn’t want to be quoted, 
trick! with a 
No! 


My psychologist has to be more 


please.” Cute Leaving everybody 


severe case of frustration and disillusionment 
He t'ain’t for me 
daring and forceful. Not afraid to discuss contro- 
versial issues and alwa 


Nice guys 


ready to back up his 


argumentations don’t make good psy 


chologists, to borrow a phrase from the manager 


of the now defunct New York Giants with of 
course a er . rhit ati 
TRAINEE 

Patient I: Dr. C reminds me of Patient III. His 

manner and character actions at times are quite 

identical. They both smoke a pipe and want to 


give the impression of God-like appearance of 


knowing all the unsolved conflicts of the mind. I 
think Dr. C likes me and I like him but I think a 


little less of Freudian theory and a more realistic 


approach would integrate him better with the pa- 
tients. 
Patient Il: Reminds almost 


self because of his ugly face I feel I’m not alone 


immediately of my- 


because of a bad face, that he is a psychologist 
and I’m a patient. How he will react in front of 
females because of it. Otherwise he has in my 
never taken too great a part in our discus- 
Just keeps on taking notes. 

Patient III: Dr. C shows signs of intelligence 
when dealing with problems. Falls into the group 
of likeable, intelligent, compatible, understanding. 
My preference is Dr. C. He thinks I’m a partially 
active patient, one who can divert the train of con- 
versation at times. 


mind 


sions. 
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Patient IV: Nice, warm, individual who puts the 
patient at e»se and gains his confidence. (I am 
speaking about myself.) He takes an active interest 
and sympathizes with individual’s problems. He 
comes down to the patient’s level and is not afraid 
to admit that he does not know the answer to a 
problem or that he does not fully understand a 
patient’s illness. Dr. D strikes me as being the 
opposite of this. 

Patient V: Quiet, reserved, pleasant student. 

Patient VI: I have no impression of him. I 
don’t come on the day [Therapist C] is there. 

Patient VII: I bear no prejudices against this 
gentleman. But I can’t stand this man’s ugly 
countenance. Not only does it turn my stomach but 
it always reminds me of the anguished filled years 
during my late teens and early twenties when I 
suffered for similar reasons. I could never relax in 
this man’s presence and if he were a very notable 
psychologist his therapy would never register with 
me. Every time I came into the room I’d get a 
sickly feeling in the pit of my stomach and would 
mutter to myself: “Wish this man would turn to a 
different vocation rather than psychology.” 


TRAINEE D 


Patient I: He has me puzzled his approach is 
not to my liking. To let patients chatter along 
without some intervention is wrong. I like Dr. D 
but sometimes I think he looks upon me as some- 
thing lower than himself. 
impression of him is a frustrated playboy. I think 
Dr. D has the least sympathy at certain times and 
when this happens it makes me furious. I think 
that’s why I miss [his] group sessions. 

Patient II: I felt good in his presence the first 
time I met him because he let me dominate the 
conversation when Patient IV and I were all alone, 
and I talked about myself. Recently two weeks ago, 
they had a completely new group, and I felt uneasy 
in these new fellows’ presence. Dr. D didn’t help 
me along. Therefore, I don’t feel like coming to 
the Group on his days. 


Patient III: Dr. D impresses me as being the 
most interesting in terms of conversation. He is 
also very intelligent in bringing out the trends of 
people’s minds by graphic expressions of demon- 
stration. 

Patient IV: Very cold and detached individual. 
In dealing with the patients in the group he strikes 
me as being very unsympathetic to patient’s prob- 
lems or the patient himself. Realizing that he uses 
a certain type of therapy which may make him 
seem like this I still feel that no matter what type 
of therapy he would use he would still be cold and 
detached from the patient. His manner. makes me 
very conscious that I am a patient (very much in- 
ferior to him) and that he is the doctor (his being 
so much better and superior to me). In other words 
he makes me feel that because he’s the doctor he’s 
very normal and because I’m the patient that I’m 
mentally deranged. 

Patient V: Quiet, seems reserved in attitude. 


When this occurs, my: 


Participates actively but nonemotionally as group 
supervisor. 
Patient VI: He is a shy retiring sort of a fellow. 


He seems self-conscious every time a member of 
the group asks him a direct question. His activ- 
ities in the group in my opinion show his inability 
to really direct the group by himself when Dr. 
Luchins is not there. His voice is quiet and lacks 
aggression needed to.make the group feel confi- 
dent in him. He doesn’t seem interested in the 
group. 

Patient VII: Another nice guy and very photo- 
genic too. The women nuts ought to find him sim- 
ply. . .as you say in French: “Tres adorable, n’est 
pas.” Same major faults as Mr. B—too soft spoken, 
too quiet, too well behaved. No fire, no electricity, 
no fission, etc. Again I must impress the hierarchy 
of the psychological and psychosomatic universe 
that a psychologist must be aggressive and forceful. 
I don’t mean domineering and dictatorial. But you 
must feel his presence the moment he sits down be- 
side you and elucidates on psychological theories 
and practices. He studied and his diploma says 
that he is an expert. And if you are an expert 
then why all this timidity and inhibitedness. No 
neurotic in his right “mind”. . .or whatever “mind” 
he possesses. . .feels secure enough in the presence 
of a Psychologist who measures every word. And 
then when you are leaving the group therapy ses- 
sion you keep saying to yourself I don’t know just 
how this “guy” ever got a degree on Psychology. 
That’s all, folks!! There ain’t any more. 


EXCERPTS FROM TRAINEES EXPRESSED 
REACTIONS 


For comparative purposes, we quote from 
the reactions of the four co-leaders referred 
to in the described sample of patients’ express- 
ed impressions. These reactions were obtained 
in writing or during individual conferences 
with the author. 


TRAINEE A’S REMARKS 


Psychologists more or less agree about patients 
except with some slight projections. . . . The great- 
est majority of the patients prefer a direct and 
guided approach. They expect something they can 
put their teeth in. . . . The therapists can learn 
from this experience since we do not realize how 
we are viewed and what our roles are. ... I know 
what patients want but whether it is best for them, 
I don’t know. The material shows emphasis on 
what is wanted from the therapist. I may give even 
more of the same now that I know what they 
want. . 


Most of the impressions the patients have of me 
run pretty much as expected, but I was surprised 
at the attitude the patients had of other therapists. 
For example Patient I called Dr. C immature (he 
is the most mature of all the therapists). It could 
be that they don’t like nondirective therapy, wheth- 
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er or not it has benefits. 

As a teaching device: 1) This gets the reaction 
of the patients towards the therapists; 2) It gets 
the therapist to see objectively what he is doing; 
3) It can give the therapist an idea of himself as 
a provocateur. You see what you provoke in them. 
If everyone repeats the same criticism you have to 
infer that this response was provoked by something 
in you and not in their projections. . . . 


They do not like a therapist who is reserved 
and not interested in them as individuals. They 
want warmth. They felt that Dr. D was above 
them because perhaps he was keen and sharp and 
not interested in them as individuals. ...A reason 
why the patients reacted the way they did to me 
was due to a natural characteristic of mine, of be- 
ing intimate and talking to people as if I were in 
the same boat as they were. I am a rather friendly, 
sympathetic person. Evidently they do not see me 
as a father image. 


TRAINEE B’S REMARKS 

Patient I disappointed me. Patient VI did not 
make this statement. This was added in by you. 
It doesn’t fit in with my conception of him. He 
would not have answered unless he were forced. 
How hard did you have to push him? .... I am 
able to fit in their interpretations of me. It modi- 
fied my self concept. . . .knowing the concept they 
hold of me enabled me to see the distortions they 
made and how it fits in with their problems. 


Interne A was pleasantly distorted just like D 
was distorted in a bad direction and this was due 
to the fact that you are an influencing factor. You 
must have made statements to them. . . . It seems 
that the more dependent patients were more in- 
clined to be in line with your attitude. For ex- 
ample, A was more out to please than D, therefore 
they had a more favorable attitude towards A. 
This doesn’t mean that A gives them better ther- 
apy. You may get better therapy from a person 
from whom you get hostile reactions. 

Perhaps all this is due to my being influenced 
at the present time by the teachings of the Sullivan 
approach, that is, what the patient likes or dis- 
likes must not be taken into account; that in thera- 
py we must be on guard not to permit the patient 
to utilize the same kind of power maneuvering in 
the therapeutic situation which he utilizes in his 
ordinary daily interpersonal relations. To do that 
is to allow the patient to do what he ordinarily 
would be doing and it vitiates the therapy. 

This technique is good for collecting research 
material. The relationship of feelings and sympa- 
thies of patients, and their reactions to sympathies 
and feelings of therapists, and vice versa, can be 
studied but it will not show anything about thera- 
py or whether or not the patients were helped by 
the therapists. 


TRAINEE C’S REMARKS 


s never thought that Patient I would be all 
Positive, but he was very negative. I would have 


expected more of that from Patient IV but I did 
not get it. Patient II’s statement about me was 
based on a purely external relationship—not since 
I was 17 did I feel as strongly emotionally to- 
wards my face as when I read his impression. His 
impression was just what I had pictured others as 
thinking of me when it then bothered me. It was 
exactly the same irrational idea I once had. I can- 
not handle this impression. I cannot handle 
VII! He is very perceptive. There is an element of 
truth in what he said of everybody. 

It made me appreciate that it was impossible for 
me to take the view that I had taken in the be- 
ginning. I thought that I could sit in the room 
and that they would think of me more or less as 
nonexistent. Yet in spite of my trying to do this, 
they developed a real attitude towards me. This 
shows that you cannot assume that patients will 
not develop a real attitude towards you, because of 
your actions. Perhaps the important thing is that 
you have to get involved with them. If you give 
the impression of being involved and being one 
of them, then the impression is favorable. 


This is a good teaching device: 1) It is an op- 
portunity for reality testing of ideas. 2) It reveals 
what a person really feels about you and you can 
compare it with what you think he felt about you 
and what you think about him. 3) It showed me 
that one cannot remain a nonparticipant observer. 
It also showed me that I had misjudged the 
feelings the patients had towards me. This is an 
entirely different approach than the control an- 
alysis technique because there you do not have 
a sample for reality testing. It is second line stuff. 
It is deducing from evidence what the patient may 
have thought about you. In this method it is hard 
to rationalize away what they say or thought 
about me as can be done in control analysis. When 
I attempted to rationalize, the thought occurred to 
me that everybody said more or less the same 
thing about me so that my explanation for what 
they said about me didn’t hold water. Moreover, 
somebody who had done just what I said was the 
reason for their impression of me, had gained a 
different impression in his patients. I am _ better 
able to accept when I see what really is said about 
me, than when someone says to me what someone 
feels about me. 


TRAINEE D'S REMARKS 


My first reaction to the patient’s impressions was 
to rationalize by calling them negative transfer- 
ence, but I couldn’t feel satisfied with it. ... I 
had the biggest reaction to the statements of Pa- 
tient I whom I felt I was moving. I was surprised 
at Patient IV. Certain elements of the impressions 
seem to be correct. I have an air of superiority 
and detachment at times but feel that I never 
showed this nor held this attitude towards IV and 
I. . . . VII’s statement about being a frustrated 
playboy has some truth to it. I was struck by the 
reactions they had to others. . .amazed by the fa- 
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vorable reaction to A. Jt seems that they do not 
want a therapist but someone who will have sym- 
pathy and understanding. 

It is not possible to sit in a group till you have 
a relationship. You must develop a relationship. 
Maybe I lacked the emotional involvement. I felt 
that I should not become involved in it. I do not feel 
that group therapy should be so satisfying to them. 
I felt that it should be sustaining but not an emo- 
tional force. 

The interesting thing was to compare what they 
said about me and what they said about each of 
the other therapists. There seems to be consis- 
tency, with every patient saying the same thing 
about me. It is difficult to say, therefore, that it 
was projection. It is really very revealing to see 
how sensitive these people can be and what they 
can pick up. ... This technique is something you 
rarely get in therapy training. . It is good to 
force the therapist to see his own misgivings. It 
is kind of a group therapy in return for the thera- 
pist. 


SAMPLES OF ISSUES DEALT WITH IN THE 
JOINT SEMINARS 


The discussions held in the various joint 
seminars varied considerably since the in- 
ternes present were free to raise any problems 
they wished. Among the issues usually dis- 
cussed were the following: 


1. What is the relationship between the patient’s 
overtly expressed formulations and his actual im- 
pressions of and reactions to the trainees? Did 
the patient fail to express himself freely, perhaps 
because he feared to, did not care to, or was un- 
able to express his reactions in words? During 
the course of the discussion of these questions, it 
was mentioned that the expressed formulation 
might conceivably be dependent upon particular 
situational conditions, e.g., the atmosphere of the 
individual or group session during which the pa- 
tient was asked to indicate his responses, the pa- 
tient’s mood, the fact that the questions were asked 
by the group leader and not by someone else, and 
the fact that they were asked in the clinic rather 
than outside of it [cf. 2]. Granting that the ob- 
tained impression might not coincide with the ac- 
tual impression, and granting further that both 
the overtly expressed and the actual impressions 
might be highly dependent on situational factors 
[cf. 2], we contended nonetheless that the prob- 
lems remain of ascertaining (a) why the formu- 
lated impressions were given and (b) what sig- 
nificance they hold for the trainees. 


2. Was the consistency in the patients’ reactions 
to some of the trainees a resultant of prior dis- 
cussions among patients? Did one patient per- 
chance make some remark about an interne which 
was picked up by the others and expressed as their 
own opinion? We pointed out that even if this 
had occurred, it would not eradicate the need for 


ascertaining the foundation for the original re- 
mark and for determining why another patient 
should remember the remark and be willing to ex- 
press it as his own opinion. 

3. Was the permanent group leader held up by 
some patients as a standard against which the in- 
ternes were measured? In this connection it was 
noted that some patients appeared to regard the 
trainees as assistants or students in spite of the 
fact that they were introduced to the group as 
staff psychologists. Did the patients prefer those 
trainees who attempted to emulate the permanent 
leader’s approach? Was there perhaps a direct re- 
lationship between the patients’ attitudes toward 
the permanent leader and their attitudes toward 
the trainees, so that like (or dislike) of the leader 
would go hand in hand with favorable (or un- 
favorable) impression of trainees who attempted 
to follow in the permanent leader’s footsteps? It 
is hoped that some light will be thrown on these 
problems by a study of the relationship between the 
patient’s expressed impression of the permanent 
leader and his expressed impression of the various 
trainees. 

4. As an outgrowth of the discussion of issues 
mentioned in the preceding paragraph, the fol- 
lowing problems were raised for general considera- 
tion: Would the impressions of a trainee have dif- 
fered if he had attended more of the group meet- 
ings? Would they have differed if the permanent 
leader had attended fewer of the meetings? 
Would they have differed if the trainee had not 
been a “part-time” therapist but had been the sole 
therapist in charge of the group? 

5. We considered the problem of what the part- 
time therapist can hope to accomplish. The opinion 
was expressed that patients tend to expect the ap- 
proach utilized by the permanent therapist. Some 
internes suggested that in order to avoid confusing 
patients and creating disorganization in the group, 
and for the sake of the smooth progress of the 
sessions, it might be best for the part-time ther- 
apist to attempt to emulate the approach of the 
permanent therapist. It was pointed out that this 
would be particularly advantageous if the part- 
time therapist had the opportunity to work with 
several therapists, since he would then enhance 
his experience with and his ability to utilize vari- 
ous approaches, 

6. Why did the patients appear to have unfa- 
vorable impressions of those trainees who avoided 
direct participation in group sessions or who 
sought to utilize a nondirective approach? Was 
this because they thought that such internes were 
deliberately avoiding helping the patients, or was 
it because they thought that such internes did not 
have sufficient knowledge to participate actively? 
There arose the question of whether these trainees 
would have been more favorably accepted if they 
had been more skillful in their use of a nondi- 
rective approach, if the permanent leader had 


utilized such an approach, or if the patients had had 
any prior experience with nondirective therapy. 
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7. The present author raised the following prob- 
lems for consideration. Do the patients’ expressed 
formulations of a trainee reflect the latter’s actual 
role and function in the group? Do they yield a 
true indication of the effect the trainee is having 
on the group, of how he affects the group struc- 
ture, group organization, and group behavior? In 
other words, do certain kinds of group structures 
and activities tend to be associated with each of 
the internes, and if so, what is the relationship be- 
tween the nature of the structure and activity, and 
the nature of the expressed comments? 


SUGGESTED UTILIZATIONS AND 


OF THE PROCEDURES 


VARIATIONS 


1. It may prove of interest to repeat the 
questioning of the patients and co-leaders 
several times throughout the group psycho- 
therapy program. Comparions of the resulting 
sets of responses may be able to suggest ans- 
wers to such questions as these: How do a 
patient’s responses compare before and after 
his apparent recovery? Do the patients tend 
to persist in their initially offered impres- 
sions? Will this occur even if the internes 
have made deliberate attempts to change their 
roles in the group sessions? 

2. It may be of interest to have the interne 
serve as a part-time therapist in one group for 
a few months, then in another group for a 
few under different 
leaders. Will the remarks of the patients con- 
cerning the reveal a_ consistency 
from group to group in spite of the difference 
in group composition and group leadership? 
For comparative 


months, and so on, 


co-leader 


some trainees 
should be told of what the patients had said 
about them in previous groups prior to their 
entering a new group; in other cases such in- 
formation should be withheld until the end 
of the entire study. 

3. We believe that it is of interest to study 
the roles played by the patients and therapists 
through various means (group dynamic tech- 
niques, sociometric devices, etc.) and then to 
compare the outcomes with (a) the roles 
which a patient reports he and others are 
playing and (b) the roles which a therapist 
reports he and others are playing. 

4. The basic assumption of this study—that 
one can gain an understanding from the pa- 
tient of how he perceives the therapist and the 


purposes, 
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therapeutic situation—has broader impli- 
cations than those which we have developed 
in this report. Using the kind of questioning 
technique reported in this paper, one can at- 
tempt to obtain from the patient an indication 
of his reactions to (a) the permanent group 
leader, (b) other patients in the group, (c) 
visitors to the group, and (d) other clinical 
personnel, including the therapist who sees 
him in individual sessions. Similarly, one can 
attempt to obtain the patient’s views on pro- 
cedures utilized in administration, examina- 
tion, and treatment. For example, a certain 
technique or approach may be considered by 
the clinician as conducive to a certain social 
atmosphere (say, permissive) and a certain 
patient-therapist relationship. But is this as it 
is perceived by the patient? In other words, 
how does the patient’s reported perception of 
a procedure compare with the clinician’s re- 
ported perception of it? 

5. It seems to us that the procedures de- 
scribed in this paper have implications for 
training in methods. Thus, 
after witnessing several individual or group 
psychotherapy sessions, the observer should 
formulate his impressions of the roles played 
by the patients and therapists, as well as his 
impressions of their reactions to each other. 
He should then be permitted to see the re- 


observational 


sponses which the patients and therapists gave 
when questioned concerning each other. Dis- 
cussions of the differences between his formu- 
lations and those obtained from the patients 
and therapists may hint at possible weaknesses 
in his observational techniques, and may pro- 
vide him with a basis for sounder observations 
in subsequent sessions. 
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FACTOR ANALYSES OF PSYCHOANALYTIC, NON- 
DIRECTIVE, AND ADLERIAN THERAPEUTIC 
RELATIONSHIPS’ 
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?-g~ WO previous papers by the author [2, 
3] described the methods used in quan- 
tifying and comparing therapeutic re- 
lationships created by ten experts and non- 
experts of the psychoanalytic, nondirective, 
and Adlerian schools. The results of these in- 
vestigations showed that the therapists who 
are considered to be experts by their colleagues 
create a relationship which approximates more 
closely the concept of the ideal therapeutic re- 
lationship which has previously been described 
[2] than do the relationships created by non- 
experts. It was also demonstrated that experts 
create therapeutic relationships which are more 
similar to relationships created by experts of 
different schools and less similar to those creat- 
ed by nonexperts of their own school. The 
present paper will describe the results of multi- 
ple factor analyses of therapeutic relationships 
and discuss in more detail some of the dimen- 
sions which differentiate experts from non- 
experts, and therapists of one school from those 
of another school. 


The hypothesis of this and previous investi- 
gations has been that the therapeutic relation- 
ship is not a function of a particular theory or 
technique but rather of other determinants 
which are concomitant with expertness and 
therapeutic skill. For lack of a better criterion, 
expertness is here accepted as the reputation 
which the therapist enjoys among his col- 
leagues. In turn, this investigation concerns it- 
self with isolating the more specific aspects 
which are inherent in therapy conducted by 
experts (presumably “good” therapy) by con- 
trasting it with therapy conducted by non- 


1The writer wishes to express his appreciation 
to Dr. D. W. Fiske, and Messrs. R. W. Heine and 
R. D. Quinn for their suggestions and criticisms of 
this paper. 
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experts (which presumably is less good), and 
that we shall thereby be able to identify ex- 
pertness without recourse to such standards as 
and status based theoretical 
writings or administrative ability. This paper 
will attempt to identify the specific aspects 
which are common to therapeutic relationships 


reputation on 


created by experts regardless of school. 
PROCEDURE 


Since the methodology and rationale, as well 
the and limitations of these 
studies, have already been presented in some 
detail [3] they will only be briefly summa- 
rized here. One psychoanalytically trained, one 
nondirectively trained judge, one judge (the 
writer) who had received some training in 


as restrictions 


both methods, as well as one judge who had 
received no training in therapeutic theory or 
methods, listened independently to ten record- 
ed therapy interviews, each of which they as- 
sessed in terms of an array of 75 statements de- 
scriptive of therapeutic relationships [see 3, pp. 
438-439] in accordance with usual Q-technique 
methodology [1, 4]. The assessments of each 
judge were then intercorrelated and the result- 
ing correlation matrices factor analyzed [5]. 


The were obtained 
from four psychoanalytic, four nondirective, 
and two Adlerian therapists who were asked 
for one recording between the sixth and seven- 
teenth treatment hour with a patient whom 
they considered neither psychotic, encepha- 
lopathic, psychopathic, nor incompetent and 
who permitted the hour to be recorded. The 
therapists were so selected that two of the four 
psychoanalytic therapists were relative begin- 
ners, one an expert who enjoys national reputa- 
tion, and one a therapist who enjoys a more 
limited reputation as an expert. The same is 


recorded interviews 
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true of the four nondirective therapists, while 
one of the Adlerians is a nationally recognized 
expert and the other a beginner. 

Since each judge’s training and orientation 
were different, it was felt that the assessments 
of each judge should be treated separately. The 
study thus contains four factor analyses.?* 
Each judge was also asked to identify the 
factors from his assessments in terms of his 
own frame of reference. 

The statements which constitute the basis 
of the factor interpretations will be summa- 
rized in this paper. The code numbers refer to 
the statements which are listed in the previous 
paper [3]. This will enable the reader who 
so desires to go back to the statements which 
emerged as factors. 


THE RESULTS 


Judge H. The oblique, rotated factor matrix 
(Table 1), obtained from the ratings of the 
psychoanalytically trained judge, yielded four 
factors. 


Factor H-A was named “Insecurity ex- 


pressed in immobility.” The second nondirective 
expert and the two nondirective nonexperts 
showed high factor saturations; the Adlerian 
expert emerged with a moderate negative fac- 
tor saturation and is, therefore, on the opposite 
pole of this particular dimension. 


Therapists with high factor saturations are de- 
scribed as: 64. The therapist feels somewhat tense 
and on edge.* 65. The therapist seems to be a 
little afraid of the patient. 113. The therapist lets 
the patient determine the course of the session. 
(Also 24, 103.) Statements less characteristic of 


2Each correlation matrix was factored twice to 
improve communality estimates. The actual factor- 
ing was done by Mr. John Mellinger of the Psycho- 
metric Laboratory, Department of Psychology, The 
University of Chicago, to whom the writer wishes 
to express his appreciation. 

®To reduce printing costs, 16 tables showing cor- 
relation matrices, factor matrices, and distribution 
of residuals have been deposited with the Ameri- 
can Documentation Institute. Order Document 2933 
from American Documentation Institute, 1719 N 
Street, N. W., Washington 6, D. C., remitting $.50 
for microfilm (images 1 in. high on standard 35 
mm. motion picture film) or $1.60 for photocopies 
(6 x 8 in.) readable without optical aid. 


*Statements descriptive of factors in this study 
were obtained as follows: Items were selected on 
which therapists with high factor loadings were 
rated similarly while therapists with low factor 
loadings obtained scores on that statement which 
were higher or lower by one or more points. 
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therapists with high factor saturations are, for in- 
stance: 72. The therapist’s feelings do not seem 
to be swayed by the patient’s remarks. 31. The 
therapist is usually able to get what the patient 
is trying to communicate. (Also 135, 141, 134, 131, 
43, 63, 54, 42.) This judge felt that the statements 
tended toward a description of a therapist who, 
when he feels insecure in the face of implicit de- 
mands by patients, responds by stiffening and fall- 
ing back on an overly rigid use of technique. 


Factor H-B was named by Judge H “Poor 
communication.” One of the nondirective non- 
experts, ND-N2°, and the Adlerian novice had 
high factor saturations on this factor, while 
the nationally known nondirective expert has 
a high negative factor saturation, that is, has 
“good communication” with his patient. ‘This 
factor describes therapists whose tensions are 
expressed in a need to impose their own notions 
on the patient at the expense of “not hearing” 
expressions of the patient which are contradic- 
tory to the therapist’s beliefs. 


Statements characteristic of therapists high on 
this factor are, for instance: 12. The therapist often 
misses the point the patient is trying to get across. 
135. The therapist directs and guides the patient. 
65. The therapist feels somewhat tense and on edge. 
15. The therapist’s comments tend to divert the 
patient’s trend of thought. (Also 4, 3, 14, 13, 2.) 
Statements less characteristic of therapists high on 
this factor are: 73. The therapist maintains a 
friendly, neutral attitude throughout. 25. The ther- 
apist usually maintains rapport with the patient. 
(Also 124, 25, 41, 44, 31, 111.) 


Factor H-C was named “Security expressed 
in optimal emotional distance.” All experts 
except ND-E2 have high saturation on this 
factor while only one nonexpert, PA-N1, does 
so. This factor describes a therapist who is 
neither too intimate nor too distant from his 
patient and hence can interact freely without 
tensions. The therapist is interested, but not 
involved, in the patient’s problems; he is de- 
tached from the patient’s problems but not 
aloof and coldly disinterested. 

Statements characteristic of therapists with high 
factor loadings are: 73. The therapist maintains a 
friendly, neutral attitude throughout. 31. The ther- 


apist is usually able to get what the patient is 
trying to communicate. 


5The notations in this paper are the same as 
those used in the previous paper [3, Table 1]. 
PA—Psychoanalytic E—Expert 
ND—Nondirective N—Nonexpert 
IP—Individual Psychology (Adlerian) 
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Statements less characteristic of these therapists 
are: 1. The therapist cannot maintain rapport with 
the patient. 11. The therapist flounders around be- 
fore getting the patient’s meaning. 4. The thera- 
pist’s own needs completely interfere with his un- 
derstanding of the patient. (Also 103, 112, 12, 64, 
65.) 


The fourth factor, H-D, was labelled 
“Empathy.” Only experts received high satu- 
rations on this factor: PA-E1, ND-E1, ND- 
E2, IP-E1. Therapist ND-E2, the only expert 
not represented on Factor H-C, has the highest 
saturation on this factor. Factor H-D is also 
closely allied to therapists’ ability to com- 
municate; the statements concern the ther- 
apist’s ability to maintain rapport, to follow 
the patient’s line of thought, and to show lik- 
ing for the patient. 


Statements more characteristic of therapists high 
on this factor are: 25, 34, 123, 94; statements less 
characteristic of therapists high on this factor are: 
$, 2, 52, 14. 


TABLE 1* 
Roratep Osiique Factor Matrix (Jupce H) 














Therapists H-A H-B H-C H-D 
PA-E1 (Psychoanalytic) -—01 -17 35 52 
PA-E2 x6 -03 -04 60 -09 
PA-N1 a 09 02 43 08 
PA-N2 . 29 45 -08 -0l 
ND-E1 (Nondirective) 02 -52 44 32 
ND-E2 <5 53 —06 02 58 
ND-N1 - 53-01 00 22 
ND-N2 “ 59 03 00 -02 
IP-E1 (Adlerian) —36 08 51 32 
IP-N1 4 04 70 07 00 





*Decimal points have been deleted in this and subse- 
quent tables. 


TABLE 2 
CORRELATIONS BETWEEN PRIMARY VECTORS 
(Jupce H) 


H-A, H-B, H-C, H-D, 





H-A 


Pp 
H-B, 28 — 
H-C, 75 4 -- 
H-D, -11 22-05 — 





It will be noticed that experts are most 
prominently differentiated on the two factors 
which deal with communication and proper 
emotional distance (H-C and H-D). Four of 
the five experts and only one nonexpert have 
high loadings on one or both of these factors. 
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The ratings of the psychoanalytically trained 
judge do not show any factors which would 
differentiate one school clearly from another. 
Only Factor H-A (“Insecurity expressed in 
immobility’) singles out three of the four non- 
directive therapists to the exclusion of all 
others. Even here, however, we cannot con- 
sider this factor as representative of one school 
since the nationally known therapist, who is 
undoubtedly the most representative therapist 
in the group, has a zero saturation on this 
factor. 

Judge Q. The nondirectively trained judge 
described his Factor Q-A as follows: ‘“Thera- 
peutic approach or attitude factor: emotional 
stability, interest in, and esteem of the patient, 
communication excellent on both, the intel- 
lectual and affective level.” All experts and 
no nonexperts have high factor saturations on 
this factor, which is quite similar to Factors 
H-C and H-D obtained from the ratings of 
the psychoanalytically oriented judge (see 


Tables 3 and 4). 


The statements which characterize this factor 
concern mainly the aspects of communication and 
proper emotional distance, e.g.: 75. The therapist 
shows little positive or negative emotion in his re- 
actions to the patient. 71. The therapist is interested 
but emotionally uninvolved. 44. The therapist’s re- 
marks fit in just right with the patient’s mood and 
content. 42. The therapist is able to participate 
completely in the patient’s communication. Other 
statements more characteristic of therapists with 
high factor loadings are 72, 32, 43, 81, 31, 83, 
while statements less characteristic of “high” thera- 
pists are 12, 64, 1, 3, 5, 14, 51. 


Judge Q named the second factor “‘ Personal 
security—insecurity factor: emotionally 
estranged—submissive, protective.” Therapists 
PA-N2, ND-N1, ND-N2 have high loadings; 
ND-E2’s factor loading is relatively slight. The 
statements which characterize this factor de- 
scribe the therapist as being a little afraid of 
the patient, hesitant about asking questions, 
apologetic, currying favor, etc., in other words, 
insecure and trying to please. 





Statements characteristic of therapists high on 
this factor are: 65, 111, 114, 103, 104, 112, 131; 
statements less characteristic of these therapists are 
72, 133, 55. 


The third of Judge Q’s factors was named 
“Status superiority factor: emotionally 


estranged—dominating, aloof, or cold.” This 
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factor is the opposite in many respects from 
Factor Q-B. Therapists PA-E1, PA-E2, PA- 
N1, and IP-N1 have high saturations and the 
nondirective therapist ND-N2 a moderate sat- 
uration on Factor Q-C, which characterizes 
the therapists as relatively more rejecting, con- 
descending, with a more tutorial attitude to- 
ward the patient. 


Statements 53, 132, 141, 143, 133, 142, 145, and 
54 are more characteristic of therapists with high 
factor saturations; 113, 112, 102, 103, 104, 115, 131, 
92, 101, and 45 are less characteristic of therapists 
with high factor saturations. 


The last factor in this group, Q-D, isa resid- 
ual factor which cannot be interpreted on the 
basis of our factor loadings. 

As in the case of Judge H’s ratings, dif- 
ferentiation between experts and nonexperts is 
most clearly apparent in terms of the ther- 
apists’ ability to communicate and relate emo- 
tionally in a manner which is neither too close 
nor too distant to the patient. Differences be- 
tween schools do not emerge clearly, but where 
they tend to be present, i.e., Factors Q-B and 
Q-C, they are in terms of status differences. 


TABLE 3 
Roratep Ostique Factor Matrix (Jupce Q) 


Therapists ~ Q-A QB Q-C Q-D* 
PA-E1 (Psychoanalytic) 69 07 53 23 


PA-E2 ” +4 02 73. «—-18 
PA-N1 “s —03 00 80 -17 
PA-N2 “ -09 62 -04 04 
ND-E1 (Nondirective) 77 02 02 -14 
ND-E2 & 77 30 01 16 
ND-N1 r 02 74 07 01 
ND-N2 " 10 55 34S -07 
IP-E1 (Adlerian) 83 -09 24 12 
IP-N1 <8 -35 05 52 21 





*Residual factor. 














TABLE 4 
CoRRELATIONS BETWEEN PRIMARY VECTORS 

(Jupce Q) 

ai QA, Q-B, Q-C, Q-D, 

Q-A, — 

Q-B, 2 = 

C-Q, -14 17 —_ 

Q-D, -21 -39 04 _ 





Judge F. This judge, the writer, had 
received some training in both psychoanalytic 
and nondirective therapy. Since the writer 


knew the identity of all therapists, these results 
must be accepted more cautiously. 

Factor F-A was named “Security and ther- 
apy centeredness.” The factor is described by 
the attempt on the part of the therapist to 
understand his patient’s feelings and focus on 
the patient’s thinking, in the course of which 
status concerns of the therapist are completely 
overshadowed. Thus, the therapist is described 
also as acting neither superior nor submissive to 
the patient, treating the patient like a friend 
while not diverting the patient’s trend of 
thought, missing the patient’s point, showing 
the patient condescending, hostile or tutorial 
attitudes, etc. (see Table 5). 


Statements 33, 124, 41, and 125 are characteristic 
of therapists with loadings on Factor F-A; 
ef t35, th = 143, 52, and 144 are less 
characteristic of ND-E1, ND-E2, ND- 
Ni. IP-N1 has a high negative saturation on this 
factor. 


high 
134, 
therapists 


This factor is the only one of eleven which 
singles out two experts and one nonexpert of 
one school to the exclusion of therapists of 
other schools. This factor was named without 
reference to the therapists who obtained high 
factor loadings on it, and one would imagine 
that the statements correspond rather well with 
the “Client-centered attitude” which Rogers 
has described. On the other hand, the writer 
knew, of course, whom he was rating at the 
time these assessments were made. 

Factor F-B was named “Poor rapport, and 
insecurity.” All nonexperts and no experts 
received high factor saturations on F-B. This 
is therefore another factor which clearly dif- 
ferentiates experts from nonexperts regardless 
of school. Again, the aspect of communication 
and security are prominently brought out in 
the statements which characterize the factor. 
Therapists are described as having no compre- 
hension of the feelings the patient is trying to 
communicate, missing the point the patient is 
trying to make, being able to understand only 
the intellectual aspects of what the patient is 
saying, feeling tense and on edge, etc. 


Statements 2, 4, 12, 13, 14, 64, 23, 24, and 1 
are more characteristic of therapists with high fac- 
tor saturations; 41, 33, 31, 35, 93, 94, 32, 144, 122, 
92, 42, and 45 are less characteristic of these thera- 
pists (the nonexperts). 


Factor F-C was named “Superiority” ; ther- 


a 
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apists PA-E1, PA-E2, PA-N1, IP-E1, and IP- 
N1 received high loadings on this factor. Al- 
though none of the nondirective therapists has 
a high loading on this factor, one of the psycho- 
analytic nonexperts also has a zero correlation. 
This factor, which is highly correlated with 
Factor F-A (.75) (see Table 6), also tends to 
differentiate among schools, though with a 
great deal more overlap. In both factors over 
half of the statements come from the Status 
role dimension of the scale [see 3}. 

The last factor, F-D, was named “Pass- 
ivity’; PA-E2, PA-N1, ND-E1, and ND-NI 
have moderate factor saturations, whereas the 
loading of ND-N2 is barely interpretable. 

Statements which are characteristic of this 
factor describe therapists as letting the patient 
determine the course of the session, showing 
little emotional reaction, being interested but 
emotionally uninvolved, hesitant about asking 
questions, etc. 


Statements 113, 75, 71, and 111 are characteris- 


tic, and 55, 135, and 95 are less characteristic, of 
therapists with high saturations on this factor. 


As in the ratings of previous judges, the 
factor related to communication differentiates 
between experts and nonexperts most clearly. 
One factor has emerged which differentiates 
three of the four nondirective therapists from 
therapists of other schools. Nondirective thera- 
pists are here described as being less status con- 
scious; some of the psychoanalytic therapists 
and the Adlerians, as can be expected, are seen 
as more authoritarian, tutorial, and with 
greater tendency to guide and direct the pa- 
tient. 

Judge W. Four factors were obtained from 
the matrix of Judge W, the rater who had 
never done nor been in psychotherapy. Factors 


TABLE 5 
Rotated Ostique Facror Matrix (Jupce F) 
Therapists F-A F-B F-C F-D 
PA-E1 (Psychoanalytic) —-04 07 58 10 
PA-E2 06 11 50 53 
PA-N1 es -05 56 43 50 
PA-N2 “ 09 56 -05 -05 
ND-E1 (Nondirective) 47 -06 07 48 
ND-E2 i 54 07 +-02 08 
ND-N1 ” 43 48 -07 43 
ND-N2 i -03 69 03 34 
IP-E1 (Adlerian) 0s -02 43 -06 
IP-N1i 9 —50 66 36 10 
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TABLE 6 
CorreLaATions Between Primary Vectors 
(Jupcer F) 


F-A, F-B, F-C, F-D, 
F-A, ~ 
F-B, 11 - 
F-C,, 75 -25 —_ 
F-D, —35 06 41 
W-A and W-D are positively correlated 


(.67) ; Factors W-B and W-D are negatively 
61) (see ‘Tables 7 and 8). 
Judge W named Factor W-A “Self confi- 
dence and sincere interest in the patient.” ‘he 
two nondirective experts, ND-E1 and ND- 
E2, received high factor loadings; PA-E2’s 
and PA-N2’s loadings are slight; the Adlerian 


correlated ( 


novice, IP-N1, received a high negative factor 
loading. 
This 


indicate rapport and acceptance of the patient, 


factor consists of statements which 


as well as a measure of participation on the 
part of the therapist. 


Statements 25, 74, 122, 135, and 35 were char- 
acteristic of therapists with high factor saturations; 
143, 63, 4, 


therapists. 


and 145 were less characteristic of these 


Factor W-B was named “Inability to cope 
with the patient due to lack of insight.’’ Only 
therapist ND-N2 received a high factor load- 
ing; IP-N1’s factor saturation is slight. 

The statements descriptive of this factor 
indicate lack of rapport, some anxiety on the 
part of the therapist, lack of understanding of 
the patient’s feelings, as well as the therapist’s 
inability to take some positive action. 

Statements 1, 2, 65, and 3 are characteristic; 121, 
122, 135, 21, 71, 34, 22, and 25 are less character- 
istic of therapists with high factor loading. 

Factor W-C, “Poor rapport,” is somewhat 
similar to the previous factor. ‘The therapists, 
PA-N1 and PA-N2, are seen as aloof and un- 
able to understand and interact with the pa- 
tient on an emotional level. 


Statements 24 and 61 are characteristic, while 
statements 41, 73, 42, 43, and 45 are less char- 
acteristic, of therapists with high factor saturations. 


The last of Judge W’s factors, W-D, was 
named “Emotionally close relationship.” Only 
therapists IP-E1l and PA-N1 have interpre- 
table factor saturations. This factor is correlat- 
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ed with Factor W-A, “Self confidence and sin- 
cere interest in the patient.” Although Judge 
W labelled the factor “Emotionally close re- 
lationship,” the statements seem rather to de- 


scribe a relationship in which the therapist is 
quite active. 


Thus, the two statements characteristic of thera- 
pists with high factor loadings are, “The therapist 
talks down to the patient as if he were a child,” 
and, “The therapist treats the patient like his pu- 
pil.” (Statements 141 and 134). Less characteristic 
of these therapists are being “cool to the patient,” 
drawing emotionally away from the patient, and 
being hesitant about asking questions, (Statements 
61, 62, and 111.) 


The two correlated factors, W-A and W-D, 


TABLE 7 


Roratrep Osiique Factor Matraix (Juoce W) 


Therapists W-A W-B W-C W-D 
PA-E1 (Psychoanalytic) 25 01 —07 30 
PA-E2 ” 34 05 -20 24 
PA-N1 of 00 07 60 -04 
PA-N2 a 32-08 56 02 
ND-E1 (Nondirective) 61 12 08 03 
ND-E2 ” 58 —09 01 —3 
ND-N1 9 02 27 22 00 
ND-N2 a —02 58 -O1 -01 
IP-E1 (Adlerian) 00 —0)3 —02 43 
IP-N1 " —61 31 09 28 


TABLE 8 


CoRRELATIONS Between Primary VECTORS 


in combination encompass all experts, and 
they include only one nonexpert (PA-N2) 
whom Judge W considered to be a good ther 
apist. Although the factor patterns obtained 
from the ratings of this judge were not as clear 
and unequivocal as those obtained from the 
trained judges, we can again find the aspects 
of communication and emotional distance as 
the most salient elements of the therapeutic 
relationship. Again we find no factor which 
differentiates one school from another. 
DISCUSSION 

The hypothesis of this investigation has been 
that the therapeutic relationship is a function 
of expertness rather than a particular theory 
or methodology. This hypothesis has been sup- 
ported in the present investigation. While we 
have found several factors which clearly dif- 
ferentiate experts from nonexperts, only one of 
the factors has differentiated three therapists 
of one school from those of another school. As 
can be seen from ‘Table 9, there are no factors 
which characterize therapists of any of the 
three schools. We are 
speaking of a typically psychoanalytic or a typi- 
cally nondirective or Adlerian therapeutic re- 
lationship. 


thus not justified in 


As has also been pointed out in a previous 
paper [3], the most characteristi 
the relationship 


aspects of! 


which 


(Juvce W) differentiate experts 

- from nonexperts, presumably “good” from 

W-A, W-B, W-C, W-D, “poor” therapists, is the greater ability of the 

W-A, _— expert to understand the feelings of the pa 

W-B, —33 -— tient, his greater security in the therapeutic 

W-C, —24 47 _— situation, and his capacity to show interest and 

W-D, 67 ~61 -08 _ warmth without becoming overly involved 
TABLE 9 


Judge H (PA) 


Judge Q (ND) 


Factor PATTERNS OBTAINED FROM THE Four JUDGES 


Judge F (PA &ND) Judge W (UNTND) 


Therapists A B C D a 7. ae a 82 &-B ia Sse SB 
PA-E1 (x) X X x X (x) 
PA-E2 xX x X = = (x) 

PA-N1 7 X fa tae | X 
PA-N2 xX xX xX (x) xX 
ND-E1 -X X (x) X xX xX X 

ND-E2 x x xX xX 

ND-N1 xX X x = xX 

ND-N2 x =m xX (x) xX 

IP-E1 -(x) X (x) xX xX xX 
IP-N1 xX —(x) xX -X X (x) -X (x) 





X Factor loadings above .60 
X Factor loadings between .40 and .59 
(x) Factor loadings between .30 and .39 
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with the patient. Whether or not the therapist 
is “directive” or “nondirective” does not seem 
to affect his ability to communicate in our sense 
of the word. We are dealing here, of course, 
with a broad concept of the words “under- 
standing” and “communication.” Also includ- 
ed in these terms are rapport, and ability to 
listen “with the third ear.” It is, perhaps, in 
this respect that the investigations, based on 
wire recorded interviews, have the greatest 
advantage over typescripts. It is true that much 
of the content of the interaction is soon forgot- 
ten by the listener, but in return he retains a 
definite feeling for the atmosphere and the ten- 
or of the interaction. It is this somewhat in- 
tangible component which we have here at- 
tempted to quantify and factor. 

This investigation raises again the question, 
how can this additional evidence contribute 
to more effective training of therapists? One 
is almost driven to conclude that the teaching 
of how to create effective therapeutic relation- 
ships (rather than technical information on 
how to interpret or reflect) is perhaps a task 
which might profitably be left for parents or 
perhaps as second choice to training-therapists. 
While it should be relatively simple to decide 
on the basis of this or similar techniques of 
measurement, who is capable of establishing 
good therapeutic relationships with patients, 
and thus, who has become a good therapist, 
we are still not in the position to provide a 
better manual for the conduct of successful 
treatment. 


SUMMARY AND CONCLUSIONS 


The present paper presents the results of 
four multiple factor analyses based on Q-tech- 
nique assessments of one wire recorded therapy 
interview from each of ten therapists. Four 
psychoanalytically trained, four nondirective, 
and two Adlerian therapists participated. 
Half of the therapists are experts of national 
or local reputation, the others are nonexperts. 
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The present paper describes the factors which 
were obtained from one _psychoanalytically 
trained judge, one nondirective judge, one 
person who has had no training in psychology 
and has neither done, nor been in.therapy, and 
the writer, who has received some psychoanalyt- 
ic and some nondirective training. 

The results indicate that therapists of one 
school do not create a relationship which is 
characteristically different from that created 
by therapists of the two other schools re- 
presented in this investigation. In each of the 
factor matrices one factor or a pair of correlat- 
ed factors was found which clearly differenti- 
ates experts from nonexperts regardless of 
school. These factors are related to the ther- 
apist’s ability to communicate with and under- 
stand the patient, and to his security and his 
emotional distance to the patient. No factors 
were found which clearly separate therapists 
of one school from those of another. The 
hypothesis of this series of investigations, that 
the nature of the therapeutic relationship is a 
function of expertness rather than school, has 
thus been further supported. 

It must be reemphasized that this study is 
subject to the same restrictions on general- 
izations which apply to the writer’s previous 
paper [3]. 

Received March 30, 1950. 
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FOUR EXPERIMENTS WITH THE SZONDI TEST" 


IRVING ARTHUR FOSBERG 


VETERANS ADMINISTRATION HOSPITAL, NEW ORLEANS, LOUISIANA 


HE Szondi Test is one of a large 

number of newcomers in the field of 

projective techniques for psychodiag- 
nosis. For details on the specific method of per- 
sonality analysis used with this test, the inter- 
ested reader is referred to Szondi [16] and 
Deri [6]. The test materials consist of 48 
photographs of men and women (portrait 
style) mounted on 2 by 3 inch cards. They are 
pictures of mental patients who have been 
diagnosed as: (a) homosexual, (b) sadistic, 
(c) epileptic, (d) hysterical, (e) catatonic 
schizophrenic, (f) paranoid schizophrenic, (g) 
manic-depressive, depressed type, and (h) 
manic-depressive, manic type. The 48 cards are 
divided into six sets of eight pictures. All 
eight pictures of each set, containing the eight 
types listed above, are placed before the subject 
who is required to select two people he likes 
the best and then two people he likes the least 
(or dislikes the most). The diagnosis is made 
from the interrelations to be found among the 
subject’s choices of likes and dislikes. 


The literature on the Szondi Test is ex- 
tremely meagre. In addition to the two texts 
mentioned and other of Szondi’s publications 
[15], it is briefly treated in Bell [2] and in 
articles by Deri [7], Rapaport [12], Stephen- 
son [14], Giuliani [10] and Balint [1]. Four 
papers on this test have been given before pro- 
fessional meetings: Calabresi [3], Davidson 
[4], Deri [5], and Fosberg [9]. Three book 
reviews have been published which have criti- 
cally analyzed the technique: Margolet [11], 
Schafer [13], and Ellenberger [8]. This is 
the total extent of the Szondi literature as of 
this date. None of the references here mention- 


1$ponsored by the Veterans Administration and 
published with the approval of the Chief Medical 
Director. The statements and conclusions published 
by the author are the result of his own study and 
do not necessarily reflect the opinion or policy of 
the Veterans Administration. 
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ed deals adequately with any portion of the 
Szondi theory on experimental grounds. These 
studies are concerned with certain problems of 
validity which Szondi and his co-workers 
have not touched. 


CHANCE AND THE SZONDI TEST 


Let it be assumed that the real basis upon 
which a subject chooses a picture is a matter of 
pure chance and is not governed by any psycho- 
logical factors at all. The number of times 
that a given Szondi type should be so chosen 
in the course of taking a test can then be 
calculated. For example, in the matter of 
“likes,” the subject is asked to choose two cards 
from the eight before him. The odds that any 
given Szondi factor, say the A factor, is chosen, 
are 2/8. The odds that it is not chosen are 6/8. 
The subject chooses in this fashion from six 
sets of eight cards. That is, he repeats this 
procedure six times. 

The odds that any given number of Szondi 
factors will be chosen as “likes” are found by 
expanding the formula (+¢)* where p = 2/8, 
q = 6/8, and n= 6. Thus, (2/8+6/8)® yields 
the probabilities: 


a) Missed entirely .178 
b) Chosen only once 356 
c) Chosen only twice 297 
d) Chosen three times 132 
e) Chosen four times .033 
f) Chosen five times .004 
g) Chosen all six times .00024 


The “dislike” series would be similar, ex- 
cept that (p+q)"= (2/6+4/6)°, and the 
probabilities are: 


a) Missed entirely 087 
b) Chosen only once .262 
c) Chosen only twice 327 
d) Chosen three times 218 
¢) Chosen four times 082 
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.016 
.0013 


Two hundred subjects were given the 
Szondi Test, and the distributions obtained 
were compared with the distributions expected 
if chance alone were operating. The subjects 
were 100 normal people (50 men and 50 wo- 
men) and 100 patients (50 men and 50 wo- 
men) in neuropsychiatric wards of two dif- 
ferent hospitals. Further, of the total of 100 
patients, 50 who were diagnosed as paranoid 
schizophrenics were separated out, and their 
data were compared with mixed psychiatric 
cases. Tables 1 and 2 present the results ob- 
tained on comparing for each Szondi factor, for 
“like” and “dislike,” the theoretical frequen- 
cies with (a) 100 normal people, (b) 100 
psychiatric cases, and (c) 50 paranoid schiz- 
ophrenics. Chi-squares were calculated (see 
Table 3) to determine probabilities that (a) 
the theoretical percentages and the normal per- 
centages come from the same population (the 


f) Chosen five times 
g) Chosen all six times 


TABLE 1 
DIsTRIBUTION OF SZONDI FACTORS 





Number of Times Chosen as “Likes” 
0 1 2 3 4 5 6 
1 





Chance 178 .856 .297 .182 .083 .004 .00024 
h* Nt “1.2182 wOiwdsiCi«wORCwOO 
P 06 .21 .19 .24 .16 .10 04 
S .08 22 .20 .26 14 .08 .02 
8 N 10.44 27 118 04 01 01 
Pp 14 27 686) «20 02s .01s«.00 
3 06.22 .66 .12 02 .02 .00 
e N 22 40 .80 .08 .00 .00 .00 
P 15 4.46 4.26 4.12 01 4.00.00 
S BY: 42 34 10 .02 .00 -00 
hy N 438 88 12 .07 .00 .00 .00 
P 39 .40 17 .08 .01 .00 .00 
s 40.88 .18 .04 .00 .00 .00 
k N 43 187 .17 03 .00 .00 .00 
P 33 .47 16 .08 .01 .00 .00 
S 86 .48 .12 .04 .00 .00 .00 
p N 08 .26 .86 .22 .07 .01 .00 
P 28 82 24 .11 04 01 .00 
3 30 .86 .18 .08 .06 .02 .00 
d N 83 87 .28 .05 4.02 «4.00.00 
P 25 .44 .20 .10 01 .00 .00 
s 30 .42 .16 .12 .00 .00 .00 
m N 08 .17 .81 .25 .15 .04 .00 
P 10.82 26 «6.22 4.09 «4.01.00 
S 08 .24 .80 .20 .12 02 .00 


*The letters in this column refer to the Szondi diag- 
nosis. 

tN: normal 
phrenics. 








subjects, P: all psychotics, S: schizo- 


TABLE 2 
DISTRIBUTION OF SZONDI FACTORS 








Number of Times Chosen as “Dislikes” 
0 1 2 3 4 5 6 
Chance .087 -262 .327 -218 .082 016 -001 








h N 85 36 18 07 .03 01 00 
P 57 -24 13 -05 -00 01 -00 
Ss -58 -20 -16 -06 .00 00 -00 











s N 18 .B6 25 15 .05 -O1 -00 
P .82 35 22 .07 .03 01 .00 
S -82 .40 -20 .04 .02 .02 -00 

e N 17 .87 82 12 .02 -00 .00 
P 10 81 46 12 01 .00 .00 
i] -10 34 -40 14 .02 -00 -00 

hy N .02 17 .43 -22 13 .03 .00 
P .07 15 -41 -27 .09 -01 .00 
S .10 .16 -84 36 -08 -00 .00 

k N 15 27 36 16 .06 -00 -00 
P 06 22 87 -26 .08 01 .00 
S .08 18 .28 .36 .08 -02 -00 

P N .82 .386 -22 10 .00 -00 -00 
P 18 84 -29 13 -06 .00 .00 
S 24 34 30 .08 .04 .00 -00 

d N 12 -81 .36 .16 .04 01 .00 
P .19 .36 .26 15 .03 .01 .00 
S 16 -82 -36 -10 -04 -02 .00 

m N $1 47 -16 -05 01 .00 -00 
P 37 .83 16 «10 -03 -01 -00 
S 32 .388 22 -04 .00 -00 .00 

TABLE 3 
PROBABILITIES TABLE 
Probability Probability Probability 

Szondi of Normal of NP and of Normal 

Factor and Chance Chance and NP 

4+* .01 01 -03 

h— 01 01 .05 

s+ 40 .20 10 

j— 01 O01 .20 

e+ 40 30 .70 

on 01 01 50 

hy+ 01 01 70 

hy— 015 20 50 

ko 01 01 .70 

k— .20 .60 .20 

p+ 01 20 01 

p— 01 01 05 

d+ .03 10 .70 

d— 40 01 95 

m-- 01 01 10 

m— 01 O01 -30 

N= 100 N= 100 N = 200 





***Likes” are indicated by + sign, “Dislikes” by — 
sign. 
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chi-squares were actually calculated from the 
obtained frequencies), (b) the theoretical and 
the psychiatric case data come from the same 
population, and (c) the normal and psychiatric 
case data have similar distributions. 

Inspection of these tables show that we seem 
to have a deviation of the obtained per cents 
from the theoretical greater than chance will 
permit in all cases except s+, e+, A—, and d—, 
for the normal group and s+, e+, hy—, k—, 
p—,and d+ for the psychiatric group. The per- 
centages of the normal and psychiatric groups 
are indistinguishable from each other except in 
the + factor. The data for the general psychi- 
atric cases and the paranoid schizophrenics are 
not significantly different from each other. 

It is concluded from these data that the 
Szondi choices cannot be accounted for on the 
bases of random selections. There is no way, 
however, of distinguishing a normal group 
from a psychiatric group on any Szondi factor 
except p+, or a paranoid group from unselect- 
ed psychiatric cases or from normals (excepting 
again, on p+ choices). 

The curves that could be derived from these 
data would all be skewed so that the higher 
incidences would be near the origin of the 
graph (at about 2.5). The curves would vary 
between unimodal and J-shaped as follows: 
unimodal: A+, s+, hy—, e+, e—, k—, pt, 
p—, d+, d—, m+; J-shaped: h—, s—, 
hy+, k+, m—. Balint [1], discussing the 
probability distribution to be expected, states: 
“On the contrary, the figures for the mathe- 
matically most probable distribution are very, 
very much smaller than expected, and, in fact, 
the extreme choices are the rule. This fact is 
a very strong argument in favor of some ef- 
fective psychological force influencing the 
choice.” Unfortunately Balint presents no 
statistics to support this statement. The data 
here presented are not U-shaped curves, as 
would be inferred to be the case from Balint’s 
statement. 

It may well be that there are psychological 
forces at work in determining the selection of 
pictures, but they are probably not what the 
Szondi workers believe them to be. 


READING PERSONALITY TYPES 
FROM PHOTOGRAPHS 


A second experiment was an attempt to see 


if people can intuitively read the personality 
type from the photographs. It might be argued 
that such judgments are made intuitively on a 
subconscious level and, hence, when we ask 
people to make these judgments on a conscious 
level, all sorts of blockings and dodges will be 
resorted to by the id to keep these judgments 
from reaching consciousness in their original 
state. This might be true of people in general, 
but others who must deal with personalities in 
a professional capacity have taken pains to 
learn, in academic courses and through clinical 
experience, to make these factors explicit and 
conscious in order that they may deal with 
them more directly. If we ask such people to 
look at the Szondi cards and make a “snap 
diagnosis,” they should do better than chance. 

A group of 43 subjects: 6 psychiatrists, 2 
clinical psychologists, 3 psychiatric social work- 
ers, 2 experimental psychologists, 4 nurses, 3 
psychiatric ward attendants, 10 student clinical 
psychologists, 6 student psychiatric social 
workers, 2 physicians (not psychiatrists), and 
5 people with some college courses in psycholo- 
gy but no training or experience in these 
previously mentioned fields of work, were 
given the Szondi Test once to demonstrate its 
method of operation. On completing this series, 
it was explained to the subjects that the test 
had included only abnormal people and was, 
as a matter of fact, limited to eight types of 
abnormals. At this point, a list with the eight 
Szondi types thereon was given to the subjects, 
and explanations were furnished when a sub- 
ject was unfamiliar with a Szondi term. The 
subjects were then asked to assign a diagnosis 
to each picture, using the Szondi classification 
only. For each picture a subject could make 
eight possible statements of which only one 
could be correct. Unknown to the subject was 
the fact that each series had only one example 
of each clinical type. Thus it is possible to 
calculate the odds that a subject will get one 
or more selections correct in each series. The 
probabilities that a subject may get any given 
number right are presented in Table 4 to- 
gether with the actual distributions obtained. 
The frequency is such that the probabilities of 
the two sets of data being mere random devi- 
ations from the same basic distribution are less 
than one in a hundred. 

It is concluded from these data that people 
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TABLE 4 
GUESSING THE DIAGNOSIS OF THE SzoONDI CARDS 
No. Times Per Cent 

Correctly Expected Obtained 
Identified by Chance Per Cent 

0 34.2 10.96 

1 39.1 28.51 

2 19.5 28.95 

3 05.6 17.11 

+ 01.0 09.21 

5 00.1 03.51 

6 00.008 01.75 

7 00.00033 00.00 

s 00.00000059 00.00 

100.00 


trained in psychology can diagnose the people 
portrayed in the test cards so as to agree with 
Szondi more frequently than chance will 
allow. 


SEX AND THE SZONDI TEST 


Szondi workers claim that the test will cor- 
rectly reflect the sex vector in so specific a 
fashion as to show in the record that a subject 
has had a discharge of sexual tension (as in a 
heterosexual, homosexual, or other type of sex 
activity) by a decrease in the number of selec- 
tions in the “sex vector,” i.e., the A and s cards 
[6, p. 72; 16, p. 259]. In order to test this, a 
group of ten young, healthy, married or single 
men and ten young, married women volunteer- 
ed to take the Szondi Test and, after each ad- 
ministration, to tell the examiner whether or 
not there had been a sexual episode within the 
last 12 hours. 


The numbers of A and s pictures selected 
have been tabulated separately for those days 
in which an orgasm took place within 12 hours 
and for those days where it had been over 48 
hours (range 48 hours to 15 days). Szondi’s 
theory calls not only for a marked decrease in 
such choices immediately post-orgasm, but also 
for an ignoring of all A pictures. This did not 
occur more than 16 times where expected, but 
it also occurred 26 times where not expected. 
Table 5 compares the distribution of h+, h—, 
s+, and s— factors before and after a sexual 
experience. 


The chi-square test was used to determine 
the probabilities that these compared distribu- 


tions are but random deviations from each 
other. The probabilities calculated from these 
data fail to negate this theory. From these 
results it is concluded that for these subjects 
the choice of “like” and “dislike” for the so- 
called A or s factors of the Szondi Test do not 
enable the examiner to make a valid judgment 
of the sex activity of the subjects. 


TABLE 5 
Sex Activiry AS A VARIABLE IN Szonp1’s 
Sex VecTor 


Number of Times Chosen 


Factor Condition 0 1 2 3 4 5 6 

h4 Control -ll -21 .32 .20 14 .02 .00 
Pre-Sex -10 -20 .24 .B4 -04 04 04 
Post-Sex .08 -24 32 .26 -10 -00 .00 

h Control SB SB BH BHM 
Pre-Sex .26 .38 .80 .06 .00 .00 -00 


Post-Sex 36 .24 .26 14 00 00 86.00 


a+ Control 10 =~«.44 27 138 04 01 01 
Pre-Sex 82 .42 18 = .00 04 04 .00 
Post-Sex 82 .34 18 = .10 -04 -02 -00 


5 Control 18 .36 .25 .16 .06~ 01 .00 
Pre-Sex 16 .28 .82 = .10 12 .02 .00 
2 00 .00 


Post-Sex 20 .86 .26 16 0 


ELECTRICALLY-INDUCED GRAND 
MAL SEIZURES AND THE SZONDI 
TEST 


The Szondi theory predicts that there will 
be a decrease in the number of paroxysmal 
vector pictures chosen immediately after a 
grand mal seizure [16, pp. 39, 93]. Twenty- 
five male subjects were tested who were receiv- 
ing electroconvulsive shock treatments as part 
of their therapy at a mental hospital. The 
Szondi Test was administered to them after 
they had recovered from a grand mal seizure 
induced by shock, and also on days when no 
seizure had been experienced during the preced- 
ing 72 hours. Table 6 compares the pre- and 
post-shock choices of e+, e—, Ay+, and h— 
(composing the paroxysmal vector), as well as 
the s+ and s— factors. The chi-square calcu- 
lated from these data fail to negate the hy- 
pothesis that the distributions are but random 
deviations from each other. 


On pages 51 and 52 of Szondi’s book [16] 
there are presented the test data of a patient 
before and after electric shock treatment. Our 
attention is directed to the change in the s 
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TABLE 6 
EST AS A .v  ARIABL E IN THE SzonpI ‘Test 


anber of Times Chosen 
Factor Condition 0 1 2 3 4 6 6 





ee Control 14 «©.44_—C«« 0 10 «6.02 00 = =6.00 
Post-shock .10 .42 .82 .14 .02 .00 8 .00 
No shock 12 .38 82 16 .02 .00 .00 





e- Control 04 .80 .60 .14 02 00 .00 
Post-shock .22 .48 .24 .06 00 .00 .00 
No shock 08 .42 .86 .10 04 00 .00 


hy+ Control 42 .88 .16 02 .02 0 .00 
Post-shock .40 44 12 .04 .00 .00 -00 
No shock 34 .44 #112 «£68 6.02) «6.00.00 
hy— Control 10 18 44 18 10 -00 -00 
Post-shock .00 .20 46 -22 .04 .08 .00 
No shock 14 12 .38 22 10 .04 .00 
s+ Control 14 22 .40 18 .04 .02 .00 
Post-shock .10 .24 «27 16 10 .02 .00 
No shock .08 .20 .36 -20 14 .02 -00 
. Control -82 -32 18 .10 -06 .02 .00 


Post-shock .38 .42 14 .04 .02 -00 -00 
No shock .34 44 14 .08 -00 -00 -00 





factor. Before shock s+ is zero and s— is 5. 
After shock s+ and s— are both zero. A 
check of the data for the above-mentioned cases 
for the s factors fail to substantiate Szondi’s 
findings. 

It is concluded, therefore, that for these sub- 
jects the Szondi factors do not distinguish the 
grand mal days from days without grand mal 
seizures. 


CONCLUSIONS 


Szondi’s theory has received some “comfort” 
from these studies in the findings that: 


(1) Chance is not the sole determiner of 
selections for “like” or “dislike.” 


(2) The p+ factor distinguishes normal 
records from abnormal records. 

(3) Some people, with training in psycholo- 
gy, can exceed chance expectancy in 
diagnosing the people in the Szondi 
pictures. 


Szondi’s theory has not been supported by 
findings that: 


(1) Szondi factors in the greater majority 
of instances do not discriminate re- 
cords of normal from abnormal people. 

(2) Szondi’s test does not discriminate be- 
tween the records of general psychi- 
atric patients and paranoid schizo- 


phrenics (except as noted for p+ fac- 
tor). 

(3) The empirical distributions do not fol- 
low the shape that would be expected 
if the Szondi theory were true. 

(4) The Szondi paroxysmal vector, or the 
s vector, shows no differential fre- 
quencies for pre- and post-electrically 
induced grand mal seizures. 

(5) The Szondi sex vector is not sensitive 
to recent vs. remote sex activity for the 
subjects studied here. 


While it is certain that chance is not the 
sole determiner of the choice of “I‘kes” and 
“dislikes,” it may well be that the choices are 
functions of certain artifacts operating in a 
fairly uniform and consistent fashion. That is 
to say, our subjects may have favored the 
photographs that were more aesthetic. 


The fact that the trained subjects exceeded 
chance in diagnosing the people in the Szondi 
pictures may only reflect the fact that there is 
a fairly common stereotype for many of these 
diseases. It is not sufficient proof upon which to 
base validity claims. 


Since the Szondi data have failed to dis- 
criminate in any way (except for the p+ fac- 
tor) normal people from abnormal people, 
paranoid schizophrenics from mixed psychi- 
atric nosologies, pre-shock from post-shock, 
pre-orgasm from post-orgasm, the claims for 
this technique must be looked upon with great 
scepticism. 


The experiments reported here are not con- 
sidered crucial. They cannot be used as evi- 
dence for the complete rejection of Szondi’s 
theories and his test. Had they had different 
outcomes they might have given Szondi some 
much needed support. As it stands, the author 
believes that the burden of proof lies heavily 
upon the users of this test and that, until ex- 
perimental evidence is brought forth to answer 
all of the pertinent questions which have been 
raised [9, 13], the Szondi Test in its present 
form should not be used in a clinical situation. 


Received May 18, 1950. 
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AN APPLICATION OF DRIVE THEORY TO 
TAT RESPONSES 


J. R. WITTENBORN anp L. D. ERON 


YALE UNIVERSITY! 


HIS is the second in a series of studies 

concerned with responses to the The- 

matic Apperception Test. In an earlier 
study [8] the implications of two assumptions 
were examined by means of an analysis of the 
stories produced by college students in a self- 
administering TAT situation. The results 
indicated that various features of TAT re- 
may be correlated with each other 
whenever they are the result of a common pat- 
tern of motivation. Mere superficial similarity 
between different responses was not sufficient 
to cause correlation. 


sponses 


In the present report the drive evocation — 
drive reduction paradigm of behavioristic psy- 
chology is interpreted in such a manner that it 
may be applied to the TAT situation and em- 
ployed as a basis for predicting the manner in 
which TAT responses will be intercorrelated. 

In applying this molar paradigm of behavior 
to the TAT stories, the motivational or drive 
pattern is considered to be determined to an 
important degree by characteristics of the 
cards. Most of the cues which elicit appropri- 
ate responses are also considered to be intrinsic 
to the cards, and the response, which presuma- 
bly has drive-reducing value, includes the pa- 
tient’s stories and is limited in range by the ex- 
amining situation. No statements concerning 
the exact nature of motivational patterns or 
higher order drive patterns are necessary for 
the immediate purposes of the present analysis. 
Drive patterns are merely constructs. If they 
lead to the design of effective experiments, their 
use as intervening variables is justified. The gen- 
eral value of intervening variables in experimen- 
tation requires no defense, and their value in the 


?The authors wish to acknowledge gratefully the 
material support of M. A. May, Director of the 
Institute of Human Relations. The senior author 
is responsible for the theoretical formulations. The 
data were provided by the junior author. 
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clinical study of the individual has long been 
taken for granted. For example, the psychoana- 
lytic interpretation of an individual’s behavior 
makes implicit use of extraordinarily complicat- 
ed intervening variables. In experiments such 
as the present one only relatively simple and 
direct uses of an intervening variable are at- 
tempted. 

In this experiment, it is particularly con- 
venient to think of drive reduction as being 
mediated by a response and the duration of a 
behavioral sequence as being determined by the 
time elapsing between drive arousal and drive 
reduction. The TAT permits the individual 
to respond freely to each situation as it is 
presented, and the drive pattern evoked by any 
particular card is likely to be reduced (insofar 
as the individual has responses effective for re- 
ducing the drive) by the spontaneous response 
to the card. Accordingly, a drive pattern 
evoked by one card is not likely to influence ap- 
preciably the response pattern to some card sub- 
sequently presented. 

An attempt shall be made to apply the fore- 
going considerations to dysphoric features of 
responses to the TAT cards. It is consistent 
with the trend of the present discussion to sup- 
pose that situations which elicit dysphoric re- 
sponses in the same individuals are also situ- 
ations which to a discernible degree tend to 
evoke similar drive patterns in these same in- 
dividuals ; i. e., it is consistent with the general 
trend of the present discussion to expect a 
tendency to respond dysphorically in one situ- 
ation to be correlated with a tendency to re- 
spond dysphorically in some other situation 
only when the two situations evoke a similar 
drive pattern. 


The present analysis is based on the follow- 
ing informal statements of assumptions: 
I. Certain situations arouse a pattern of ex- 
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citement called a drive. (For any given situ- 
ation this varies somewhat in nature, and for 
a sample of individuals the range of variation is 
determined by variations in the backgrounds? 
of the individuals comprising the sample.) 

II. Most individuals in the sample have 
learned one or more means of responding to a 
drive pattern so that the drive is reduced in 
intensity. (Accordingly, a drive-reducing re- 
sponse is available in many relatively free un- 
structured situations such as provided by pro- 
jective tests. ) 

III. The particular nature of the drive 
determines the particular nature of probable 
responses. 

The present investigation is concerned with 
testing some of the hypotheses which are 
generated primarily by Assumptions I, II, and 
III. The hypotheses cannot be considered as 
deduced in any rigorous and delimited manner 
from these assumptions only. 


In order to facilitate the statements of hy- 
pothesis, the relevant TAT responses were 
classified independently with respect to (A) 
similarity of response features, and (B) 
motivational implication of response features. 

A. Similarity of response features. 


1. Response features which are discernibly 
similar to each other. 

a. Emotional tone. The emotional tone rat- 
ings for responses are based on apparent 
similarity of euphoric and dysphoric features 
of stories regardless of the exact contexts in 
which they occur. The studies of Eron show 
that the emotional tone features of stories 
(responses) can be rated in a reliable manner. 
[4]. 

b. Outcome. The story response presumably 
reduces the drive evoked by the card. The out- 
come response occurs after the story response. 
The patent similarity from card to card of the 
outcome response requires little comment, and 
judges can rate the outcome for different cards 
with respect to its euphoric-dysphoric impli- 
cations in a confident and reliable manner [4]. 

2. Response features which bear a limited or 
negligible similarity to each other. 

a. Tone and outcome. Although the emotion- 
al tone and outcome ratings have a similar 


2By background is meant everything that has oc- 
curred prior to the time of testing. 


form and content, they obviously refer to 
quite different features of responses to TAT 
card situations (see statements A-1l-a and A-1-b, 
above). 


B. Similarity of motivational features. 
1. Motivational features which are dis- 


cernibly similar or obviously related to each 
other. 


a. Outcome. The outcome response is a 
result either of the subject’s spontaneous 
compliance with the examiner’s request for an 
outcome or a result of a second request (the 
examiner’s inquiry). The apparent similarity 
of the situations (instructions or require- 
ments) producing the outcome response implies 
that they may evoke similar drive patterns. 
Therefore, for the purposes of this experiment, 
the outcome rating is judged to be based on 
responses which are somewhat similar to each 
other with respect to the drives they reduce. 

b. Outcome and emotional tone for the same 
card. The outcome rating is based on response 
features which may reduce two drives evoked 
by the outcome requirement. It is presumed 
that one drive is evoked by the outcome re- 
quirement per se (see B-l-a) and this drive is 
considered to be similar from card to card. 
The second drive evoked by the outcome re- 
quirement is considered to comprise a partial 
re-evocation of the drive pattern which the 
card itself evoked initially. 


The emotional tone rating is considered to 
be based on response features which are de- 
termined by the drive pattern evoked initially 
by the card in question. Therefore, by virtue 
of the second component of the drive evoked 
by the outcome requirement, the outcome rat- 
ing and the emotional tone rating for the same 
card may be considered in many instances to 
reduce a common portion of drive. 


2. Motivational features which bear no dis- 
cernible similarity to each other. 


a. Tone. The emotional tone rating is appli- 
ed to the story response to a particular card. 
Unless the cards bear marked similarity to each 
other (or unless some theoretical interpretation 
requires common motivational features), there 
is no reason for supposing that the emotional 
tone of the responses to different cards reduces 
a common drive pattern. 


b. Emotional tone for one card and outcome 
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for a different card. There is no reason for 
supposing that the responses which provide the 
basis for the emotional tone rating for one card 
reduce the same drive as the responses resulting 
from the outcome requirement for another 
card. 


The following hypotheses specify the man- 
ner in which the outlined TAT responses will 
be correlated with each other: 

Hypthesis A. Dissimilar responses which ap- 
pear to result from situations evoking a com- 
mon drive will be more highly correlated with 
each other than dissimilar responses which 
have no common drive will be correlated with 
each other. 


Prediction 1. A distribution of the corre- 
lation coefficients yielded for a group of TAT 
cards by the process of correlating the emotion- 
al tone rating for a given card with the out- 
come rating for the same card will comprise 
larger coefficients than the distribution of cor- 
relation coefficients yielded for a group of 
TAT cards when the emotional tone rating for 
one card is correlated with the outcome rating 
for some other card. 


Hypothesis B. Similar responses which ap- 
pear to result from situations evoking a com- 
mon drive will be more highly correlated with 
each other than similar responses which have 
no apparent common drive will be correlated 
with each other. 

Prediction 2. The distribution of correlation 
coefficients resulting from correlating the out- 
come rating for one card with the outcome rat- 
ing for another card will comprise larger 
coefficients than the distribution of correlation 
coefficients resulting from correlating the emo- 
tional tone rating for one card with the emo- 
tional tone rating for another card. 


Hypothesis C. Similar responses without an 
apparent common drive will be no more highly 
correlated with each other than dissimilar re- 
sponses without a common drive are correlated 
with each other. 


Prediction 3. The distribution of correlation 
coeficients resulting from correlating the 
emotional tone rating for one card with the 
emotional tone for another card will comprise 
coefficients no larger than the correlation 
coefficients resulting from correlating the 
emotional tone rating for one card with the 


outcome rating for another card. 


DATA 


The data for the present analyses were 
selected from data gathered in earlier experi- 
ments [1, 4]. The subjects who provided the 
original data comprised four groups of twenty- 
five each. The first two groups included male 
students enrolled in the introductory psycholo- 
gy course at the University of Wisconsin. The 
third group consisted of neurotic male out- 
patients seen at a mental hygiene clinic and the 
fourth group consisted of neurotic male in-pa- 
tients under treatment at a neuropsychiatric 
hospital. All four groups were evenly dis- 
tributed as to age, education, 1Q, and marital 
status. For the purpose of earlier [1, 4] stu- 
dies, the protocols were analyzed for both the 
general emotional tone and the outcome of the 
stories. Reliable ratings were made of the af- 
fective level of the emotional tone of the stories 
for each card and the affective level of the out- 
come for each card. 


The present analyses were based on the cod- 
ed ratings of affective level for the emotional 
tone of the stories for each of nine cards (2, 4, 
7BM, 8BM, 12BM, 17BM, 18BM, 20) and 
the coded ratings of affective level for the out- 
come of stories for thirteen cards (2, 3BM, 4, 
6BM, 7BM, 8BM, 12BM, 13MF, 15, 17BM, 
18BM, 20). 


THE ANALYSES 


The analyses required by each of the three 
predictions will be presented separately. 

Prediction 1. Inasmuch as it was convenient 
to analyze the emotional tone ratings for nine 
cards only, the status of Prediction 1 is depen- 
dent primarily on nine correlation coefficients, 
i.c., the correlation between each of the nine 
emotional tone ratings and the outcome ratings 
for the respective cards. All but one of these 
correlations were positive, and four of the nine 
were significantly greater than zero. Since the 
analyses were concerned with the outcome rat- 
ings for thirteen different cards, a large 
number of correlations between the emotional 
tone rating for one card and the outcome rat- 
ing for some other card was available; it was 
possible to compute 108 correlation coefficients. 
In Table 1, the distribution of the nine with- 
in-card correlation coefficients between emo- 
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TABLE 1 
Tue DistripuTion OF Pearson Propucr MOMENT 
CORRELATION COERFFICIENTS (7) REQUIRED 
TO Test PREDICTION 1 


The Class Intervals of r 
1.00 -.20 -.10 .00 10 =.20 
to to to to to to be 
20 -.10 .00 10 .201.00 & 
Distribution of r's 

between emotional 

tone and outcome 

ratings for the 


same-card ¢ 0 1 0 3 6 9 
Distribution of r’s 

between emotional 

tone and outcome 

ratings for 

ie 2 15 33 40 14 4 108 


different cards 


Combined distribution 2 15 34 40 17 y 117 


tional tone and outcome is contrasted with the 
distribution of the 108 between-cards corre- 
lation coefficients for emotional tone and out- 
come. The difference between these two dis- 
tributions is quite conspicuous and may be 
taken as good evidence for the validity of Pre- 
diction 1. It is interesting to note that the be- 
tween-card correlations tor emotional tone and 
outcome yield a distribution of coefficients 
quite similar to that which would be expected 
for samples drawn from a population wherein 
the true correlation is zero. About 5 per cent of 
the correlation coefficients are significant at the 
5 per cent level. 

Prediction 2. The data relevant to Predic- 
tion 2 are summarized in Table 2. The out- 
come ratings make possible the calculation of 
seventy-eight different correlation coefficients 
between cards for outcome ratings. Approxi- 

TABLE 2 
DISTRIBUTION OF PEARSON Propucr MoMENT 
CORRELATION COEFFICIENTS (r) REQUIRED 
TO Test PrepicTion 2 


THE 








“The Class Intervals of r 





~1.00 —.20 -.10 .00 10 .20 on 
to to to to to to ss 
-.20 -.10 .00 .10 .201.00 
Distribution of r’s mK Spey ie 
between outcome 
ratings for 13 
different cards i) 0 . £82 78 
Distribution of r’s 
between emotional 
tone ratings for 
9 different cards 1 * 9 iil 4 8 36 


Combined distribution 1 8 14 84 $81 26 114 
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mately one-third of these correlation coefficients 
are significant at the 5 per cent level 
and no significant negative intercard cor- 
relation coefhcients between outcome ratings 
are revealed in this distribution. Table 2 also 
presents the distribution of the thirty-six corre- 
lation coefficients resulting from correlating 
the emotional tone for each card with the emo- 
tional tone for every other card. The number 
of correlation coefficients which is significant at 
the 5 per cent level is approximately the 
number that would be expected if chance alone 
were operating and in general the distribution 
of correlation coefficients between emotional 
tone ratings appears to be the kind of distribu- 
tion one may expect to obtain quite frequently 
when samples are drawn at random from a 
population wherein the true correlation coefh- 
cient is zero. 

Prediction 3. The distributions relevant to 
Prediction 3 are given in Tables 1 and 2. Since 
both may be considered to be 
drawn from populations wherein the true cor- 


distributions 


relation is zero, they obviously provide no chal- 
lenge to the validity of Prediction 3 (see ‘Table 
3). 

TABLE 3 
A Cut1-Square Test RELEVANT TO PREDICTION 3 


Number of r’s between 
Ratings for Different Cards 


Positive Negative Total 

Tone and Tone 50 (51)* 68 (57) 108 

Tone and Outcome 18 (17) 18 (19) 86 
Total 68 76 


144 


*The numbers in parentheses are the frequencies to be 
expected if there is no difference between the two dis- 
tributions. 


From the practical standpoint the impli- 
cations of these analyses have a particular in- 
terest. They invite us to consider the possibility 
that the emotional tone of the responses of edu- 
cated individuals is not a pervasive ubiquitous 
thing which colors all current responses re- 
gardless of the precise contexts in which they 
are elicited. They strongly suggest that the af- 
fective quality of responses, particularly in 
situations such as provided by projective tests, 
is determined largely by the situations which 
elicit the responses and not by some general 
affective state of the individual. Because of 
this we are obliged to consider certain interest- 
ing possibilities. 
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(a) These results are consistent with the 
possibility that for most circumstances the dy- 
namic importance of general mood has been 
overemphasized. A wide variety of drives with- 
in an individual may produce responses to 
which the culture can apply such terms as 
happy or unhappy. According to this interpre- 
tation, affective classifications of responses or 
designations of mood may tell us no more than 
how the society probably classifies the various 
aspects of the individual’s behavior. These 
culturally determined classifications may be re- 
levant to the culture only and may provide no 
understanding of the behavior of the individual. 
Ascribing a particular mood to a given individ- 
ual may be a gratuitous imputation based on a 
mere prevalence of response features which are 
judged to have a particular affective level. The 
factors necessary for the manifestations of vari- 
ous responses having a particular affective level 
may be unrelated, e.g., may have nothing to do 
with an integration of drive patterns or a 
generalization of response patterns. 

(b) It is possible, as suggested in consider- 
ation (a), that general mood or affective level 
is nothing more than an observer’s judgment 
based on the coincidental appearance of numer- 
ous responses which are judged to have a par- 
ticular affective quality. This argument is far 
from compelling, however. When a given af- 
fective quality characterizes the responses of 
an individual in a variety of circumstances, it 
seems very plausible to account for this either 
in terms of a common drive pattern or in 
terms of some kind of generalization of re- 
sponse features. Nevertheless, if the affective 
quality of response has such a broadly integra- 
ted behavioral basis, the implied intercorre- 
lations among the response manifestations hav- 
ing a given affective quality are not revealed by 
the TAT data employed in this study. If af- 
fective level exists either as an integrated drive 
pattern or as some kind of generalization of re- 
sponses, the present data and analyses do not 


show the TAT to be an appropriate instru- 


ment for evaluating it in the individual. 

These data are most provoking of conjec- 
ture, and it would be unfortunate if their im- 
plications were overgeneralized. It is quite pos- 
sible that relatively sophisticated subjects, such 
as the group of educated individuals who pro- 
vided the data for the present analyses, do not 


pay 


directly reveal the quality of their general af- 
fective level in their responses to the TAT 
cards. It is also quite possible that more naive 
subjects or more profoundly disturbed subjects 
(wherein greater apparent differences in mood 
levels occur) would provide a different kind 
of data; their responses should be analyzed 
with this possibility in mind. 

‘These analyses suggest that caution be ob- 
served when attempting to infer the individu- 
al’s mood from the emotional tone of his TAT 
stories. They suggest also that a request for an 
outcome will give a response with some affec- 
tive stability (validity of outcome affect is pos- 
sible but not certain). These analyses also have 
interesting theoretical implications; they sup- 
port the implication of an earlier analysis by 
Wittenborn [8], i.e., that the responses to the 
TAT cards can best be understood in terms of 
the motives which they serve. The results of 
the present analyses confirm predictions which 
are based primarily on an employment of the 
drive evocation—drive reduction paradigm of 
the behavior theorists. Although the theoretical 
formulations employed in the present report 
have no pretension to logical rigor and may 
possibly comprise a misinterpretation of the 
drive paradigm, this limited attempt to use the 
drive paradigm has been rewarding. It is hoped 
that through such exploratory thrusts some 
logically coherent and experimentally verifi- 
able basis may be developed for many of the as- 
pects of clinical psychology which are now con- 
sidered to be intuitive, evanescent, intangible, 
or in some other way exceptional to a disciplined 
approach. 


SUMMARY AND CONCLUSIONS 


The present report describes an attempt to 
employ the drive evocation—drive reduction 
paradigm of behavioristic psychology as an aid 
in predicting the manner which certain features 
of responses elicited in the TAT situation will 
be correlated with each other. There appears 
to be a variety of respects in which the concept 
of drive may be plausibly applied to the TAT 
situation. In the present analyses, as well as in 
an earlier set of analyses, the employment of 
motivational or drive considerations has been re- 
warded by positive results. In both of these 
analyses, however, only limited samples of re- 
sponses were available for analysis, and in both 
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of these analyses a number of seemingly minor 
assumptions were implicit but never explicit in 
the development of the hypotheses. Inasmuch 
as no strong claim can be made for the breadth 
of the behavior sample or for the rigor of the 
theoretical formulations, the exploratory na- 
ture of these analyses should be understood by 
the reader. Nevertheless, clinical psychology is 
without an integrating theory which leads to 
well-conceived research or practice, and prom- 
ising leads cannot be disregarded. 

Aside from its theoretical implications the 
present analysis has two practical implications: 
(a) The emotional tone of responses of college 
students to the TAT cards appears to be deter- 
mined by the cards and cannot be used as a 
means for evaluating a behaviorally homogene- 
ous general affective level of the individual ; 
(b) the outcome for the various stories appears 
to have a consistency independent of the cards 
and therefore may possibly provide a valid 
means for assessing the affective level of the in- 
dividual. 


Received February 28, 1950. 
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HE Michigan Picture Test, developed 
by the Michigan Department of Men- 
tal Health and consisting of 21 photo- 
graphs, is a projective personality test suitable 
for use with children in the eight- to fourteen- 
year age range. This is the second of a series 
of papers presenting the findings of the stand- 
ardization process of this test. The first paper 
[1] dealt with the validation of several of the 
variables used in analysis, including age and 
adjustment differences, and diagnostic and 
therapeutic implications. 

The method of selection of the pictures was 
reported in the preliminary paper. Here, we 
may briefly recapitulate to point out that the 
test stimuli were selected to sample crucial are- 
as of personal-social adjustment in which chil- 
dren frequently have problems. After extensive 
preliminary study, 21 pictures, including a 
blank card, were retained. These 21 cards were 
divided into two series of 12 cards each, with 
The 
extra, or twenty-first card, is used for boys 
only, on one of the series. 

The purposes of the present paper are to ap- 
praise the stimulus value of ten of the pictures, 
and to evaluate the effect, if any, of develop- 
mental differences, using populations of third- 
and fifth-grade children. (Complete data were 
available for ten pictures only.) A third objec- 
tive is to analyze some of the relationships be- 
tween the “obvious content” of a picture and 
the scores obtained on certain test variables. 

One of the major contributions of the 
Michigan project, aside from the development 
of “still another projective test,” is the evalu- 
ation of the influence of both scoring variables 


four pictures common to both series. 


1Based on a paper read at the 1950 meeting of 
the Midwestern Psychological Association. 
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and test stimuli on the elicitation and appraisal 
of important aspects of personality. Once these 
aspects of the problem are known, appropriate 
and significant normative data may be accumu- 
lated and utilized in increasing diagnostic ac- 
curacy and prediction for therapeutic purposes. 
As can be seen, the present study is one step in 
this total process [1, 4]. 

The 10 cards were compared on the basis of 
two easily scored and simply evaluated indices 
which had been found useful in preliminary 
study. These indices, based on the responses to 
the pictures as recorded electrically, were 
Level of Interpretation and Verb Tense. The 
subjects consist of a randomly selected group 
of Michigan public school children, 24 from 


TABLE 1 
Brier DescrirTion oF Ten StTimuLus CARDS FROM 
THE MICHIGAN Picture Test 


Original 
Card 
Number Description of Content of Card 

17 Family scene of father, mother, boy, and 
girl sitting at table, eating 

22 Long streak of lightning against black 
background 

16 Mixed group of six children playing 
checkers 

45 Blank card 

24A Schoolroom, boy passing out cards, teach- 
er, and five other children 

26A Two very young boys, undressed, stand- 
ing beside bathtub 

12 Father-daughter: father looking at girl 
sitting beside him 

5 Boy and girl in overalls, boy swinging on 

gate 

65 A boy seen from the back, standing on a 
dark street corner 

11A Close-up of girl sitting at school desk 
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the third and 24 from the fifth grades. Table 1 
gives a brief description of the pictures discus- 
sed in this paper. 

The variable Level of Interpretation refers 
to the amount of interpretation offered by the 
subject, the responses being classified on a 
twelve-point scale beginning with no response, 
having a score value of 1, and proceeding 
through various levels of “interpretation” such 
as simple enumeration of objects in the picture, 
descriptive enumeration, description of action, 
and four levels of gradually increasing infer- 
ence. The highest response, which includes an- 
tecedents and outcome of the story and feelings 
or motivation of the characters, has a score 
value of 12. 

The mean score on Level of Interpretation 
was obtained on the fifth-grade population for 
each of the ten pictures, and these scores were 
compared. The differences in means were tested 
for statistical significance. Picture 11A, a girl 
alone at a school desk, and Picture 26A, two 
boys beside a bathtub, were the most divergent 
in score value. This difference was significant 
at the 2 per cent confidence level. The remain- 
ing pictures did not yield statistically significant 
differences on Level of Interpretation. 


TABLE 2 

COMPARISON OF DEVELOPMENTAL DIFFERENCES IN 
LEVEL OF INTERPRETATION SCORES BETWEEN 
Tuirp- AND FirrH-Grape ScHoo. CuHIL- 

DREN FOR Turee Pictures 


Mean Score 


Grade 3 Grade 5 % 
Picture (N24) (N24) S.D. Diff. t ob 
45 8.67 10.04 1.19 1.37 5.48 0.1 
22 7.83 9.79 2.99 1.96 3.16 1.0 

5 8.50 9.71 2.23 1.21 2.57 | 2.0 





In order to explore the possibility of devel- 
opmental differences, the mean Level of In- 
terpretation scores of third- and fifth-grade 
children were compared. Table 2 shows the 
significance of grade differences for the three 
pictures having the greatest range in Level of 
Interpretation scores. It will be noted that the 
scores for third- and fifth-grade students are 
significantly different on Pictures 45 and 22 at 
the 0.1 per cent and 1.0 per cent confidence 
levels respectively, the highest mean at the fifth 
grade in each case. Apparently the clinician, 
when using Picture 45, the blank card, and 
Picture 22, the lightning scene, may expect 
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some inference or interpretation to be inserted 
into the stories of fifth-grade children, since the 
mean level of interpretation score falls at the 
interpretive level according to our scoring 
system, but this is not true for third-graders, 
whose mean level scores are in the descriptive 
category. 

The second variable on which the pictures 
were compared was Verb Tense. In our previ- 
ous paper [1], this variable was found to dis- 
criminate effectively between groups of well 
and poorly adjusted school children. A sepa- 
rate subscore was obtained for the percentage 
of each of past, present, and future tenses given 
in the stories in response to the picture. It has 
been found that a disproportionate emphasis up- 
on past or future tense is indicative of malad- 
justment, and that some characteristics of the 
type of maladjustment may be inferred from 
the relative overemphasis upon either past or 
future tense. 

Again, the fifth-grade population was used 
to compare the pictures for percentage of re- 
sponses to each verb tense. The ten cards differ 
significantly in almost every instance on the 
elicitation of both past and present tense. The 
differences are not so marked on future tense, 
although Card 22 differs significantly from all 
the others at the 5 per cent level of confidence 
or better with the exception of Picture 65. All 
of the pictures differ significantly from some 
others to the extent that the “norm” for future 
tense responses will have to be considered in 
terms of each specific card. 

TABLE 3 


MEAN PERCENTAGE OF REFERENCES TO Each Vers 
Tense Evicirep py THE Ten StrimuLus Carbs 
Supyects: 25 FrirrH-Grape CHILpRen 


Picture Mean % References 
Number Past Present Future 
17 27.78 68.18 4.04 
16 35.45 59.78 4.76 
22 48.90 48.90 2.19 
45 54.67 39.66 5.67 
5 39.59 56.38 4.03 
65 48.62 47.38 4.00 
24A 28.51 69.42 2.06 
26A 41.51 52.45 6.04 
11A 36.32 §8.12 5.56 
12 31.37 66.67 1.96 


The importance of the variable Verb Tense 
seems to be best measured by noting a dispro- 
portionate emphasis on past, present, or future 
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tense, and from these data it is obvious that, in 
order to establish an appropriate ratio, it is 
necessary to determine the percentage of refer- 
ences to each tense commonly elicited by a 
specific picture. Table 3 gives the mean percent- 
age of references to each tense produced by the 
separate cards. Since there are significant dif- 
ferences between most of the pictures, a dispro- 
portionate emphasis will have to be considered 
in terms of each of these pictures singly as well 
as for an entire protocol. 


TABLE 4 


DIFFERENCES BETWEEN 24 TrtIRD 
AND 24 Firru-Grape CHILDREN ON THE 


DEVELOPMENTAI 


VariAsLe Vers Tense 
Picture 
Verb Num- Mean % %o 
Tense ber 8rd 5th Diff. 8.D. t O.L. 
Past 22 4.97 48.90 43.98 11,12 18.64 0.1 
65 8.60 48.62 40.02 13.69 18.75 0.1 
45 26.04 64.67 28.63 18.54 9.04 0.1 
Present 22 87.00 48.90 $8.10 12.29 14.69 0.1 
65 84.60 47.38 87.22 12.68 13.89 0.1 
46 62.85 89.66 12.69 14.27 4.17 0.1 
Future 22 8.08 2.19 5.84 6.29 4.36 0.1 
65 6.80 4.00 2.80 6.61 2.06 5.0 
15 21.61 5.67 15.94 9.63 7.78 0.1 


Following the same reasoning, the pictures 
were compared developmentally to determine 
whether separate grade norms would be neces- 
sary for Verb Tense. Table 4 summarizes these 
data. Significant developmental differences 
were found on three cards, 22, 65, and 45, and 
these differences persist for all three tenses. It 
appears, therefore, that in utilizing this scoring 
variable it is necessary to have developmental 
norms in order to make an accurate prediction 
with regard to a specific protocol. 

In addition to evaluating developmental and 
stimulus differences, a third objective of this 
particular study was to determine whether or 
not there is any relationship between the obvi- 
ous content of the pictures and the variables 
Level of Interpretation and Verb Tense. The 
ten cards were judged independently by four 
clinicians as to type of affect expressed—that is, 
pleasant, unpleasant, or neutral—and as to 
amount of animation present in the picture. 
Only those cards on which there was complete 
agreement were used for this comparison. 
Table 5 lists the cards as they were classified. 





The fifth-grade population was used to investi- 
gate this aspect of the problem. There were no 
significant differences in Level of Interpreta 
tion scores between pictures in differing clas 
sifications of either type of affect or amount of 
animation, 


TABLE 5 
rHe STIMULI BY Four CLINICIANS 
ro THE Onvious CONTENT 


CLASSIFICATION OF 
ACCORDING 


or THE PicruRrR*® 
Type of Affect: Picture No 
Pleasant 24A, § 
Unpleasant 11A 
Neutral 45 
Animation 
Non-human 22,4 
Human with action 17, 24A, 16 
Human without action 65, 11A 


*Only those pictures are included on which complete 


agreement was obtained, 


The obvious content of the picture shows no 
consistent relationship with the Verb ‘Tense re- 
ferences of the stories, as can be seen by com 
paring Table 3 with Table 5. Cards which fall 
in the same content classification, for example 
human with action, differ from each other as 
much as cards falling into differing classes. 
This is readily noted by comparing Pictures 17 
and 16, both classified by the clinicians as hu- 
man with action. These cards differ as much 
from each other as does 17 from 11A, which is 
classified as human without action. This same 
trend can be noted with regard to the type of 
affect expressed in a picture, although the op- 
portunity for comparison of pictures within 
one classification is limited to Pictures 24A and 
5, which are called pleasant. 

These results seem to lead to the conclusion 
that the obvious content of the picture, as clas- 
sified, has no causative relationship with the 
score obtained on the variable Verb Tense and 
no effect on the variable Level of Interpre- 
tation. 


SUMMARY AND CONCLUSIONS 


1. The threefold objective of this paper was 
to evaluate ten the Michigan 
Picture Test in terms of (a) stimulus or pic- 
ture differences, (b) developmental differences, 
and (c) the relationship between the obvious 
content of the picture and the stories elicited 


cards from 
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by it. The method of evaluation was to com- 
pare the stimuli according to two test variables, 
Level of Interpretation and Verb Tense. 

2. Using a fifth-grade population, two cards 
were found to differ significantly on the vari- 
able Level of Interpretation. Most of the cards 
varied significantly in regard to the percentage 
of references to past, present, and future verbs. 

3. Developmental differences were apparent 
between third- and fifth-grade children on both 
variables. However, the most striking differ- 
ences were found on Level of Interpretation. 

4. It was also concluded that the “obvious 
content” of the picture has little relationship to 
the Level of Interpretation score or to the per- 
centage of references to a specific verb tense. 

5. While the number of pictures analyzed, 
the number of variables tested, and the range 
of population studied are limited, our findings 
suggest that the clinician may make serious 
errors in interpretation without specific nor- 
mative data for the pictures which are used. It 
is apparent that more accurate interpretation of 
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“*TAT-like” projective tests depends upon the 
accumulation of a considerable amount of such 
normative data. 


Received September 29, 1950. 
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A COMPARISON OF TWO METHODS OF 
ADMINISTRATION OF THE THEMATIC 
APPERCEPTION TEST 
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, ‘HE necessity of norms for meaningful 
and valid interpretation of TAT sto- 
ries has been pointed out by many in- 

vestigatiors [3, 8, 11, 12]. Rosenzweig [12] 

has demonstrated that through the use of 

norms, projective techniques can gain some of 
the precision and objectivity of psychometric 
methods without sacrificing any of the advant- 
ages inherent in the more subjective proce- 
dures. The difficulties which are encountered 
and the amount of time which is consumed in 
individual administration of projective tech- 
niques, however, has impeded the accumulation 
of norms, especially for the TAT, where stand- 
ard administration entails the verbatim record- 
ing by the examiner of stories given by the sub- 
ject in response to twenty pictures. Psychome- 
tric tests have a great advantage here in that 
they can be given in group situations with the 
subjects themselves completing the mechanics 
of recording, which cuts down on administra- 
tion time considerably. When this is coupled 
with machine scoring of results it is easy to see 
how psychometric tests can have standardiza- 
tion populations of one thousand and more. To 
date, the largest study to be reported on the 
TAT where there was individual administra- 
tion according to the standard procedure is one 
reported by the senior author in which there 
were 150 cases [4]. Although group adminis- 
tration of the TAT is not uncommon and has 
been reported by Clark [1], there is no satis- 
factory evidence that the material obtained by 
this form of administration is equivalent to or 
even comparable with the data elicited by 
the individual method. Since these are ob- 
jectively two very different kinds of situations, 


1The authors wish to thank Dr. Fred D. Shef- 
field for his advice in regard to the statistical anal- 
ysis of the data. 
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it cannot be assumed without further investi- 
gation that they do produce the same kind of 
data and that results from both are comparable. 
If it can be demonstrated, however, that pro- 
ductions resulting from both methods of ad- 
ministration are essentially similar, the group 
procedure can be used to build up norms for 
different sex and age groups and for various 
educational, intellectual, and socio-economic 
levels. These norms then would be applicable 
in the interpretation of protocols obtained by 
individual administration in a clinical setting. 
It is the purpose of this investigation to deter- 
mine what differences, if any, there are be- 
tween TAT productions obtained by individ- 
ual-oral and group-written administration. 
PROCEDURE 

The subjects included two groups of thirty 
male college students each. Group W, which 
received the traditional, individual treatment, 
consisted of undergraduates and graduates at 
the University of Wisconsin enrolled in the 
introductory course in psychology. Group Y, 
which received the group administration, con- 
sisted of third-year medical students at Yale 
University. The age range of the Wisconsin 
group was 20 to 35, with a mean of 24.7 years; 
for the Yale group, the range was 21 to 30, 
with a mean of 25.8 years. Nine of the Wis- 
consin subjects were married and 21 single; 
10 of the Yale group were married, 19 single, 
and one divorced. Subjects in both groups 
came from various geographical areas and were 
obviously of varied socio-economic background ; 
however, these factors were not strictly con- 
trolled. While it is not specifically known how 
comparable the two groups are in these re- 
spects, from the available information it is felt 
that such differences as may exist are essentially 
inconsequential. 
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Individual administration was according to 
the standard directions of Murray [10] with 
the one exception that all twenty cards were 
presented at a single session with a ten- to fif- 
teen-minute break between halves.? It has been 
reported by Rotter that this does not seriously 
affect the results [11]. The same examiner 
who completed all the individual TAT rec- 
ords also administered all the group tests in 
the following manner. The subjects were in- 
terviewed, six at a time. Three sets of cards 
were used, with two subjects each sharing one 
set, which was presented face down with card 
one on top. The directions to the subject, devis- 
ed to resemble as closely as possible those used 
in individual administration, were as follows: 

This is a test of imagination. Imagination, as 
you know, is one form of intelligence. On the table 
before you is a set of cards on which there are 
pictures about which you are to make up stories. 
For each one you are to tell what happened before, 
what happens in the picture, how it turns out, what 
the characters are thinking and feeling. Make up 
a plot for each one. No elaborate literary master- 
piece is necessary. You will have five minutes for 
each card. Be sure you include the elements of a 
plot for each one, that is: what happens before, 
what’s happening now, how it turns out, what the 
characters are thinking and feeling. Stop after you 
finish story ten. 

The words before, now, turn out, thinking, 
feeling were then printed in large letters on 
the blackboard in front of the students. When 
all the students had completed ten stories they 
were given a ten-minute break and then the 
following directions: 

The pictures you will see now will be more dif- 
ficult to make up stories about than the first ten 
pictures. They are more ambiguous, not as well 
structured. You will really have to use your imagi- 
nation to make up good stories about them. So give 
free rein to your imagination and make up some 
really good stories. Stop after you complete story 
number 15. 

After all the subjects had completed story 
15, the following directions were given: 

Now turn over the card. You see it is a blank 
card. Look at the blank card. Imagine you see some 
kind of picture there. Describe it. 

The examiner waited until all had finished 
describing the picture they imagined and then 
said: 

2Cards used in both groups W and Y were the 
Harvard University Press, third edition, and in- 


cluded all twenty pictures recommended by the au- 
thors of the test for use with adult males. 
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Now make up a story about it. After you fin- 
ish this story, continue until the end of the series 
of twenty cards as you have been doing. 


STATISTICAL ANALYSIS 


To determine the similarity of productions 
obtained by the two methods four variables 
were analyzed: the number of words per story, 
the emotional tone, the theme, and the level of 
interpretation. Since, in the individual method, 
the examiner is permitted to ask questions 
when any elements of the plot are omitted (e.g., 
how does it turn out?) and, in the written 
administration, there can be no such prompting 
except for the few words which were written 
on the blackboard, two counts were taken of 
the oral stories—the number of words up to the 
time the first question was asked by the ex- 
aminer and the number of words to the end of 
the story including questions. The emotional 
tone of all the stories was rated by the junior 
author, who had no knowledge of which proto- 
cols were individually or group administered. 
She rated the stories according to a five-point 
scale, going from sad to happy, which had been 
derived by Eron, Terry, and Callahan [6]. 
The thematic analysis of the stories in both 
groups was made by the senior author accord- 
ing to a previously published check list which 
was organized under themes of equilibrium and 
themes of disequilibrium [4]. Each of these 
divisions had been further subdivided into in- 
terpersonal, intrapersonal, and impersonal sec- 
tions with individuai themes in the check list 
entered under these general headings. As each 
theme appearing in the check list was encoun- 
tered in the story it was tallied. A minimum of 
interpretation was used. The only criterion of 
presence or absence of a theme was if it was 
objectively narrated by the individual telling 
the story. The level of interpretation of the 
stories, i.e., whether they were narrative, de- 
scriptive, symbolic, etc. was also noted and 
tallied according to the previously published 
list. A fifth variable, designated as “flippancy” 
of stories, was later independently analyzed by 
both authors. 


In comparing the two methods of admini- 
stration the chi-square technique was used in 
a variety of ways since all our data are of the 
frequency type. First, the data were analyzed 
on the basis of total responses, i.e., the Yale 
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(written) group was compared with the Wis- 
consin (oral) group in terms of the total 
number of times a given characteristic appeared 
in each group for all twenty stories. Such an 
analysis, however, involves the use of the total 
number of responses or frequency of appear- 
ance of each type of response without regard 
for the number of cases upon which these total 
frequencies are based. Any emphasis on one 
theme or particular emotional tone (or, on the 
other hand, the complete absence of one of the 
variables) in the record of any one or two sub- 
jects could dramatically increase certain fre- 
quencies from which we might falsely con- 
clude that the groups differ significantly along 
these particular lines. Similarly, actual differ- 
ences can be masked by such an analysis of the 
data based on the total number of responses 
rather than cases. In line with the shortcomings 
of such analysis which have been pointed out by 
Cronbach [2] and Lewis [9], the data were 
analyzed in terms of the number of subjects. In 
this particular instance, both methods yield 
comparable results with the exceptions noted. 

As has been noted above, the two groups are 
compared in terms of themes, emotional tone, 
level of interpretation, and length of story. An 
analysis involving no unwarranted assumptions 
or the use of meaningless, small N’s required 
the computation of chi-squares from 2 x 2 
tables following the determination of the 
median or mode for the total population and 
the dichotomization of the data into the 
number above and below in each group. It was 
thus possible to estimate whether any signifi- 
cant differences exist between the two groups 
in the thematic content and emotional tone for 
the entire test as well as in respect to each in- 
dividual card. 


RESULTS 


Number of words. Stories obtained in the in- 
dividual (oral) administration were obviously 
longer than those obtained in the group (writ- 
ten) administration. This was true even when 
the reference point for the oral group was 
taken as the number of words up to the first 
question asked by the examiner. The average 
number of words per subject in the written 
group is 1,420.6; in the oral group up to the 
first question it is 1,758.4; including the addi- 
tional material to questions it is 1,980.0. Table 


1 shows the distribution of subjects in both 
groups according to the number of words in 
the total stories by each subject. It is apparent 
that, although in general there are some in- 
dividuals in each group who contribute stories 
as short or as long as individuals in the other 
group, more subjects in the written group give 
briefer stories than in the oral group, whether 
the reference point in the latter is total number 
of words or merely number of words up to the 
first question. 
TABLE 1 
NumsBer OF Worps in TAT Stories Propucep sy 
Two Groups oF SUBJECTS UNDER DIFFERENT 
METHODS OF ADMINISTRATION 


Number of Number of Subjects 
Words Y (Written) W (Oral) 
Complete To Ist 
Story Question 
500 - 1,000 7 0 1 
1,000 - 1,500 15 5 10 
1,500 - 2,000 2 i4 11 
2,000 - 2,500 3 , 7 
2,500 - 3,000 2 3 0 
3,000 - 3,500 1 0 0 
3,500 - 4,000 0 1 1 
Total Number 30 30 30 


When a chi-square is calculated between the 
groups on the basis of the number of subjects in 
each group having above and below the median 
number of words, the following results are ob- 
tained: Y—W: 17.2388, Y—(W): 6.7340, 
W — (W): 2.0124.* The difference is sig- 
nificant at the .001 level of confidence be- 
tween written and oral, at the .01 level be- 
tween written and oral up to the first question, 
and at the .20 level between total oral and oral 
up to the first question. It would seem there is 
a real difference in length of protocol when 
stories are written or given orally whether or 
not we take into account the questions asked in 
oral administration. When the data are analyz- 
ed by individual cards (as in Table 2) these 
same results hold. For only three cards—1, 
6 BM, and 16—is there no significant differ- 
ence (less than .05) between the number of in- 
dividuals in each group who have above and 
below the median number of words. 





Themes. Although there is a significant dif- 


8W refers to the oral group, taking the total 
number of words as the reference point, while (W) 
includes only the number of words up to the first 
question. 
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TABLE 2 
NuMBER OF Worps IN EACH STorY PRODUCED UNDER 
Two Dirrerent Metuops oF ADMINISTRATION 











Y Ww Chi- 

Card Number (Written) (Oral) square* P 

1 2286 2343 1.6997 
2 2690 3421 4.8162 -05 
3 BM 1378 2748 5.6240 01 
4 2337 31562 4.6886 -05 
5 1923 2769 6.6664 O01 

6 BM 2428 3165 1.1720 
7BM 2067 3074 8.4444 01 
8 BM 1900 2924 6.7338 61 
9 BM 1649 2749 5.4976 -02 
10 1844 2775 7.1026 01 
ll 2490 3286 5.4976 .02 
12M 2009 8065 11.3168 01 
13 MF 2076 3346 6.7338 01 
14 1945 2705 17.2390 01 
15 2059 3019 6.6664 01 

16 2580 32256 1.6740 
17 BM 2025 2658 8.1026 O01 
18 BM 2003 2957 9.6098 01 
19 2095 2893 8.2126 01 
20 2337 $219 15.0668 -O1 





*Caleulated on basis of number of individuals in each 
group who had above/below the median number of 
words [2]. 


ference in the number of words produced by 
the two methods of administration, there is no 
difference in the amount and quality of content 
elicited, at least insofar as this content is re- 
flected in the themes of the stories. The oral 
group contributed a total of 1,373 themes and 
the written group a total of 1,327 themes, a 
difference which is not nearly significant at our 
criterion of .05 when the number of themes for 
all stories of all subjects in each group are 
summed. Table 3 represents a frequency dis- 
tribution for the number of themes in both 
groups. The chi-square between the groups on 
the basis of the number of subjects having 


TABLE 3 
THE FREQUENCY WITH WHICH SUBJECTS IN EACH 
Group CONTRIBUTE A GIVEN NUMBER OF 
THEMES UNDER Two METHODS OF 
ADMINISTRATION 








Number of Themes Number of Subjects 





Y (Written) W (Oral) 
31-35 7 2 
36 - 40 6 5 
41-45 4 8 
46 - 50 4 9 
51-55 5 2 
56 - 60 2 3 
61-65 2 1 





above and below the median number of themes, 
with 45 as the cut-off point, is .2694, which is 
not significant. Not only is the difference be- 
tween total number of themes contributed by 
subjects in the two groups non-significant, but 
so also is the difference both in individual 
themes and in subgroups of themes, such as 
total themes of disequilibrium, total inter- 
personal themes, etc. Table 4 gives the total 
number of themes of the different categories in 
both groups. When these total numbers are 
compared by the chi-square method, four dif- 
ferences are significant at or beyond the .05 
level of confidence. It is interesting that the 
written group has significantly more themes of 
equilibrium and the oral group significantly 
more of disequilibrium. When, however, a 
comparison is made of how many in each group 
have above and below the median number of 
given categories of themes for the total sample, 
none of the differences between the groups is 
significant at or near the .05 level of confi- 


TABLE 4 


Tora NuMBER OF THEMES OF VARIOUS CATEGORIES 
CONTRIBUTED UNDER Two DIFFERENT 
MeTHODs OF ADMINISTRATION 


¥ (Writ W 








Theme Category ten) (Oral) P* 
Total Parent Disequilibrium 173 191 
Total Partner Disequilibrium 171 180 
Total Peer Disequilibrium 140 140 
Total Sibling Disequilibrium 16 8 
Total Interpersonal! Disequilibrium 500 519 
Yotal Intrapersonal Disequilibrium 446 490 
Total Impersona! Disequilibrium 160 206 -02 
Total Disequilibrium 1106 1215 .05 
Total Parent Equilibrium 23 26 
Total Partner Equilibrium 39 25 
Total Peer Equilibrium 36 24 
Total Interpersonal Equilibrium 98 75 
Total Intrapersonal Equilibrium 116 76 O01 
Total Impersonal Equilibrium 7 7 
Total Equilibrium 221 158 .01 


Total Themes 1827 1373 








*Level of confidence is noted where significant differ- 
ences obtain. 


dence. Of the individual themes themselves, 
only seven, which appear in Table 5, show any 
differences between groups in total number 
which is significant at the .05 level. Six such sig- 
nificant differences could have been expected by 
chance; thus whether there are any real dif- 
ferences in occurrence of individual themes as 
between the written and oral methods is at 
present highly questionable. Only if these 
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particular themes are found to yield significant 
differences in further studies would any con- 
clusions be warranted. In addition, it should be 
noted that these chi-squares are based on total 
frequency, not on number of cases, and, fur- 
ther, that in two instances, Themes IA2t and 
IB15, the frequencies on which the chi-square 
analyses are done are very low and, thus, of 
questionable value. When the groups are com- 
pared on the basis of the number of subjects in 
each group having above and below the medi- 
an number of themes—the method recommend- 
ed by Cronbach [2 ]——no differences are found. 


TABLE 5 
Tue InprvinpvAL THemes For Wuicu Tuere Is A 
SIGNIFICANT DIFFERENCE BETWEEN Two 
Metuops OF ADMINISTRATION 


Theme Frequency Chi-Square P 
Y (Writ- W 
ten) (Oral) 

1. LA2t Restraint 8 1 4.000 .06 
2. IA8a Pressure from 

Peer & 21 4.9656 .05 
3. IBS Suicide 30 9 10.2560 01 
4. IBS Fear 15 87 8.4611 O01 
5. IB15 Intra-Aggression 1 13 8.6432 01 
6. IB19 Vacillation 7 21 6.0364 .02 
7. LIA2b Contentment with 


Partner 30 14 


5.1143 .05 


Level of Interpretation. Of the 17 charac- 
teristics which were tabulated as levels of inter- 
pretation other than ordinary narrative, there 
were three in which these two groups differed 
more than could be expected by chance at the 
.05 level of confidence. Alternate themes to the 
same card were produced 31 times by the oral 
group, buc only eight times by the written 
group (chi-square, 12.4100). The oral group 
had ten stories in which comments about the 
artistic merits of the picture were made, where- 
as the written group had only one (chi-square, 
5.8181). There were 32 humorous stories 
among the written group and four among the 
oral group (chi-square, 20.1500). When these 
data are analyzed by individuals (N60) the 
same results hold—18 of the oral group had 
one or more stories in which there were alter- 
nate themes, whereas in the written group 
there were only four subjects who had one or 
more stories with alternate themes (chi-square, 
7.6810, significant at the .01 level of confi- 
dence). Eight of the oral group had one or 
more stories with comments about artistic 


merits of the pictures and only one of the writ- 
ten group did (chi-square, 4.000, significant at 
the .05 confidence level). It seems, then, that 
only on the basis of these formal charac- 
teristics, called level of interpretation, can the 
two groups be differentiated beyond chance 
expectancy. When all tallies for every instance 
where some such formal charactertistic is not- 
ed are summed, it is found that the written 
group has 111 and the oral group 124, which 
is not significant. However, when the groups 
are compared on the basis of number of sub- 
jects in each group above and below the 
median number of tallies per individual, the 
chi-square is 3.3258, which approaches signifi- 
cance at the .05 level. 

Emotional Tone. It has been demonstrated 
by Garfield and Eron [7] that the emotional 
tone of TAT stories is generally sad. Our re- 
sults show that this is true when stories are 
written in a group situation in response to the 
pictures as well as when they are given orally 
in an individual situation. Table 6 shows for 
the two groups the total number of stories in 
each category of the rating scale. 


TABLE 6 
DISTRIBUTION OF EMOTIONAL ToNe OF SToRIES 
UNDER Two Metuops or ADMINISTRATION 


Rating of Tone 


Y (Written) W (Oral) 
-2 73 98 
1 220 245 
0 200 169 
1 99 75 
+2 Rg 11 


When the data are analyzed by individuals 
(N=60), as in Table 7, and chi-squares com- 
puted, there is no significant difference between 
the two groups in the number of stories of vari- 
ous degrees of emotional tone. Broken down 
into a card by card analysis according to the 
number of subjects above and below the medi- 
an emotional tone for the specific card, the data 
still do not reveal much difference beyond what 
would be expected by chance. The chi-squares 
for individual cards are listed in Table 8. For 
three cards—10, 15, and 19—there are differ- 
ences significant beyond the .05 level; and for 
three others—2, 3BM, and 14—the differ- 
ences approach significance at the .05 level. 
There is, thus, a suggestion that what differ- 
entiates these two groups of stories is their 
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TABLE 7 


Tue Frequency with Wuicu EAcH oF THE Five 
EMOTIONAL Tones APPEARED IN THE STORIES 
oF THE Tuirty Supyects In EAcH Group 


Number 
of Stories —2 —1 0 +1 +2 
7 wv aw «2 =o. =< 
0 4 1 1 1 22 22 
1 8 3 1 4 6 5 8 
2 10 6 2 > 2» # 
3 7 13 1 3 5 il 5 
4 3 8 3 2 5 6 a 
5 2 2 2 2 0 4 2 
6 2 9 3 7 6 1 
7 1 : £8 4 8 
8 1 5 7 3 1 2 
9 Ae oe: 
10 2 5 2 1 
ll 1 0 2 
12 1 1 2 
13 2 
j =< 380 30 30 30 80 30 30 30 80 80 
TABLE 8 


CHI-SQUARE AND P-VALUES OBTAINED FROM A CARD 
BY Carp ANALYSIS OF THE DIFFERENCES IN 
EMOTIONAL Tone OF TAT Stories UNDER 
Two Metuops oF ADMINISTRATION 


Card 





Chi-Square* P 
1 .6020 
2 3.4901 10 
3BM 3.2812 10 
4+ 1.5001 
5 1.3333 
6BM 1.2323 
7BM 1.3690 
8BM .2673 
9BM 1.6574 
10 5.4243 .02 
11 4723 
12M 5888 
13MF 2.1546 
14 3.4781 10 
15 6.6731 01 
16 1.3842 
17BM .1133 
18BM 1515 
19 5.6211 .05 
20 -7360 





*The distributions of emotional tone were such as to 
permit the use of the median as the dichotomy point to 
caleulate chi-square for cards 1, 2, 3BM, 5, 10, and 19; 
the mode for cards 4, 6BM, 7BM, 9BM, 11, 12M, 13MF, 
16, 17BM, 18BM, 20; median and mode were the same 
for cards 8BM, 15; the mean was used for card 14. 


emotional tone. The authors had the feeling 
that the differentiating factor might be “flip- 
pancy,”’ which seemed to be more characteristic 
of the stories in the Yale (written) group. 


Consequently, each author individually went 
over all the stories checking each as either flip- 
pant or not flippant. In the written group one 
author rated 60 as flippant; the other author 
rated 81 ina similar manner.* They agreed on 
53 of these. In the oral group one author 
checked one story as flippant whereas the other 
author considered none to be flippant. Despite 
the apparently broader definition of flippancy 
by one author, it is significant that they both 
found such a preponderance of flippancy in the 
written group and strongly agreed on the bulk 
of these. This latter is only a tentative find- 
ing, of course, due to the rudimentary nature 
of the ratings or possibly to some unknown 
differences in sample populations. Only the con- 
struction of more precise definition and scaling 
procedures, however, will make it possible to 
say more definitely whether one or the other 
method favors the appearance of such a char- 
acteristic. Further work is also needed, of 
course, to determine its significance and its 
counterpart in oral administration. 


SUMMARY AND CONCLUSIONS 


1. TAT productions of two groups of thirty 
subjects, one of which had been treated with 
the standard, individual, oral method of ad- 
ministration and the other with an adapted, 
group, written method, were compared by ap- 
propriate statistical methods. 


2. It was found that, in general, there was 
marked similarity between the stories contri- 
buted by the two groups, although there were 
also certain noticeable differences. In content— 
i.e., actual thematic material elicited—the two 
groups are almost identical. However, differ- 
ences in the formal aspects of the stories signifi- 
cantly exceed chance expectation. The stories 
given orally are significantly longer; this is 
true when the reference point used is either the 
number of words up to the first question asked 
by E or the total number of words in the story. 
Alternate themes and comments about the art- 
istry of the pictures are significantly more fre- 


*This “flippancy” seems to be characteristic of 
particular individuals. The number of subjects re- 
sponding so is 11, and the range of flippant stories 
for these 11 subjects extends from 1 to 19. To one 
of the Y subjects who gave many flippant stories, 
an individual, oral TAT was later administered. 
Although he did not repeat the same stories, the 
quality of his second productions did not differ 
from the first. 
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quent among the oral group; the written group 
contributed significantly more humorous sto- 
ries. The written stc.ies also differ to some 
extent (slightly better than chance expectancy ) 
from the oral ones in emotional tone: more in- 
dividuals in the written group produced stories 
of happier tone than in the oral group. It is 
pointed out that the written method seemed to 
stimulate more flippant stories; but no defini- 
tive statement can be made because of the ten- 
tative nature of the definition. 

3. On the basis of these results it is felt that, 
although the two methods of administration are 
not identical, stories obtained by the written, 
group procedure can be utilized in establishing 
norms for the TAT, at least insofar as the- 
matic content is concerned. This will make the 
collection of protocols a much less arduous 
task and will permit the building up of norms 
for various social, economic, educational, oc- 
cupational, and age level groups without too 
much difficulty. When the test is to be used in 
a clinical setting, of course, the traditional 
method of administration should be used be- 
cause of all the additional leads and informa- 
tion that can be obtained with any individual 
test and which are often lost by the grosser 
group procedures. However, since the methods 
are similar in the basic content which they 
elicit, the group norms can be used, after the 
individual administration, in evaluating the 
significance of any single protocol according to 
the techniques of interpretation suggested by 
Rosenzweig and others. 


Received April 28, 1950. 
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DIFFERENCES BETWEEN VERBAL AND PERFORMANCE 


IQs ON THE WECHSLER INTELLIGENCE 
SCALE FOR CHILDREN 


HAROLD G. SEASHORE 


THE PSYCHOLOGICAL CORPORATION 


EARS ago when we were accustomed to 

appraising a child’s intelligence with 

one test yielding a single IQ or per- 
centile rating, our clinical tasks were simpler. 
If we trusted our test and our tester, we could 
record a number in our case record and proceed 
to other evaluative problems. The single index 
of intelligence even became frozen into laws 
and administrative practices, especially with re- 
ference to defining the mentally defective. 

Our desire to secure a more complete 
picture of a person’s assets and liabilities has 
led to the development of many varieties of 
psychological tests. The old Bronner, Healy, 
Lowe, and Shimberg volume [1] is an early 
classic compilation of the gamut of ways to 
determine the abilities of the child. The edu- 
cational and vocational counselors also de- 
manded more variety in their aptitude tests. 
There was, and still is, a tendency to regard 
some tests as measures of intelligence and 
others as measures of aptitudes. To most of 
us, however, the need for a single all-embrac- 
ing number or letter-rating to define a per- 
son’s “general intelligence” is not so imper- 
ative. Most of us have advanced to the point 
of thinking in terms of multiple scores to ap- 
praise multiple abilities. We deal today with 
profiles based on several more or less inde- 
pendent test scores, each of which possesses 
some validity for clinical diagnosis and edu- 
cational and vocational prediction. 

The Wechsler-Bellevue Intelligence Scales 
are examples of the trend. The rapid growth of 
the use of these scales as standards of meas- 
urement of adult intelligence is evidence of 
the need for breaking the IQ into IQs. Even 
the eleven subtest scores are treated as sepa- 
rate measures, although many clinicians and 
research workers with clinical data seem to 





forget that these are only components of the 
Verbal and Performance scales and were not 
designed to yield adequately reliable separate 
scores. 

The breaking of the IQ into Verbal and 
Performance IQs has proved helpful, but 
some problems of interpretation have arisen. 
In our striving for orderliness in thinking 
about our clinical cases we sometimes get into 
trouble. We like to assume that for most per- 
sons, the Verbal IQ and the Performance IQ 
will be equal. Any person who shows a dif- 
ference between his Verbal and Performance 
IQs is therefore thought to exhibit evidence 
of a variation from normal which must be 
clinically important. How big a difference is 
important? Could it be that having identical 
or nearly identical IQs on the Verbal and 
Performance scales is the unusual phenome- 
non? How much of the observed difference 
in a given case is due to real differences in 
abilities ? 


ment ? 


How much to errors in measure- 


The recent standardization research of the 
Wechsler Intelligence Scale for Children 
[3] — WISC for short — afforded an oppor- 
tunity to analyze the data in such a way as 
to throw light on the problem of the impor- 
tance of differences i IQs obtained from 
verbal and performance tasks in this scale. 
Before proceeding, we should stress that 
while the present data are about the Verbal 
and Performance IQs on the WISC, the 
same problems arise about any pair of tests 
which use to secure differential scores 
from a subject. The Q and L scores of the 
ACE Psychological Examination, the vari- 
ous IQs on the California Mental Maturity 
Scale, the differences in IQs between the 
Stanford-Binet and the Wechsler or the 


we 
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Arthur Point Scale—any pair of scores being 
jointly analyzed—can be safely analyzed only 
if we have evidence which permits us to 
evaluate the significance of the observed dif- 
ferences in the scores being compared. 


To help us keep our thinking clear, let us 
coin a term. By a “discrepancy score” on the 
WISC we mean the numerical difference be- 
tween a child’s Verbal IQ and his Perform- 
ance 1Q. We will always subtract his per- 
formance IQ from his Verbal IQ. If V > P, 
the sign is plus; if P > V, the sign is minus. 
For example, John’s V-IQ is 110, his P-IQ 
is 98; his discrepancy score is +12 points. 
Joe has a V-IQ of 84 and a P-1Q of 90; 
his discrepancy score is recorded as — 6. For 
each of the 2200 subjects, 100 boys and 100 
girls at each age from 5 to 15, who constitut- 
ed the WISC standardization sample, such 
discrepancy scores were computed and form 
the basis for this study. 


THE SIZE AND IMPORTANCE OF DIFFERENCES 
BETWEEN VERBAL AND PERFORMANCE IQS 


The standardization procedures for the 
WISC were designed to result in a difference 
of zero points between the average of Verbal 
IQs and the average of Performance IQs. 
The obtained difference for each age is shown 
in Table 1. This table shows that the means of 
the distributions of discrepancy scores are es- 
sentially zero. ‘The slight differences from zero 
are due to the minor age-to-age smoothing of 
data in the construction of a single 1Q con- 
version table applicable to all ages. 


TABLE 1 
MEANS AND STANDARD DEVIATIONS OF DIFFERENCES 
BETWEEN WISC VerBAL AND PERFORMANCE 
iQs ror Eacn Ace Levet In THE 
STANDARDIZATION RESEARCH 


Standard 
Age Mean Difference Deviation 
Level (V-1Q minus P-1Q) of Differences 
5 —(),1 12.7 
6 0.5 12.0 
7 —().4 11.9 
8 —0,.2 12.1 
9 0.0 0 
10 0.2 12.3 
il 0.3 12.3 
12 -0.8 12.0 
13 0.5 7 
14 —0.8 3 
15 0.7 12.0 
All Ages 0.0 12.5 
N = 200 for each age 


Discrepancy scores may be quite large. At- 
tention should be given to the standard devi- 
ations of the distributions of observed V-P 
differences. These are similar for all ages and 
are of the order of 12.5 points of IQ. The 
similarity of these values indicates that the 
relationships between V and P scores are 
about the same at all ages. 


It should be noted that the distributions of 
discrepancies for each age approximate a 
normal curve about as closely as it is possible 
with real data. Figure 1, which shows the 
curve of discrepancies for the total sample, il- 
lustrates the almost perfect symmetry of posi- 
tive and negative differences about a mean of 
zero. We can expect about one-third of a 
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Fic. 1. Distribution of differences between Verbal and Performance IQs for 2200 cases, age 5-15, from 


standardization sample on the Wechsler Intelligence Scale for Children. 
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group of random subjects to show a difference 
between their Verbal and Performance 1Qs 
greater than 12-13 points of IQ, while in 
about two-thirds of the cases the differences 
will be smaller, from 0 to 12-13 points. 


The data force upon test interpreters a con- 
clusion of practical, everyday importance. 
While the theoretical average subject has a 
Verbal IQ equal to his Performance IQ, all 
the individual Johns, Marys, and Joes who are 
real and separate clinical cases can be expected 
to have relatively large discrepancies between 
their Verbal and Performance IQs. In fact, 
equal IQs will be rare. Furthermore, V will be 
greater than P about as often as P will be 
greater than /’. 

With this general point established, let us 
spread out more detailed data, partly to im- 
press upon ourselves the folly of over-interpret- 
ing small differences in obtained IQs and part- 
ly to give us background for understanding 
certain socio-economic aspects of differences be- 
tween Verbal and Performance IQs. 


TABLE 2 
STANDARDIZATION SAMPLE CLASSIFIED BY AGE 
Groups AND Direction oF IQ Dirrer- 
ENCES WITH MEDIAN DIFFERENCE 

For EacH Group 


Performance 
IQ 


greater than 





‘Verbal IQ 
greater than 
Performance IQs 











IQ equal Verbal IQ 

Ee ah 4 

Age % of Median %of %of dian 

Group N eases Diff. cases cases Diff. 
"oF 600 a «8 - 2 «a 
8-11 800 49 8 4 47 Q 
12-15 800 48 Q 4 48 9 
All Ages 2200 48 a 4 48 7 


There are no important age differences in 
discrepancy scores. Table 2 supplements Table 
1 and Figure 1, and shows that age bears no 
relation either to the direction or the size of the 
obtained discrepancies between Verbal and 
Performance IQs. For each age group, the 
numbers of cases in the V>P and P>V direc- 
tions of differences are about equal. The sizes 
of the median discrepancies are also essentially 
equal. 

In Table 2, the median of the differences is 
about 8 points, which bears a natural relation 
to the S.D. of 12-13 points observed before, 
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being the approximate ratio of the probable 
error to the standard deviation in a normal 
curve, 


These interpretations of Tables 1 and 2 and 
Figure 1 are clear: (1) We can expect similar 
differences between V- and P-IQs among chil- 
dren at all ages who are examined with the 
WISC., (2) Differences between /’- and P- 
IQs appear in each direction about equally 
often. (3) About one-half of the cases in a 
random run of children will have differences 
between their V- and P-IQs as great as 8 points 
or more. 


TABLE 3 


DISTRIBUTION AND CUMULATIVE PERCENTAGE OF D1s- 
CREPANCY Scores (REGARDLESS OF SIGN) FOR 
THE SAMPLE OF 2200 CHILDREN 
TESTED ON THE WISC 


Size of V and P 





Number of Cumulative 
Differences Cases Percentage 

35-4 14 100 

30-34 36 99 

25-29 68 98 

20-24 140 95 

15-19 284 88 

14 68 75 

13 74 72 

12 83 69 

11 88 65 

10 82 61 

y 117 57 

‘ 112 52 

7 163 47 

6 114 40 

5 131 34 

4 132 28 

3 124 22 

2 144 17 

1 140 10 

0 86 4 
Total N 2200 





The foregoing data and conclusions are 
essentially an answer to the question: what is 
an expected difference in IQs on the V and 
P parts of the WISC? This general fact of 
large discrepancy scores, centering around 8 
points, can also be expressed in terms of cumu- 
lative percentages. Table 3 is a sort of table of 
norms. The table accumulates the percentage 
of cases with increasingly large differences, 
beginning with those of zero differences. The 
symmetry of data observed earlier permits us to 
estimate the percentage of differences in one 
direction, either positive or negative, by taking 
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one-half of the percentage shown in the table. 
It can be shown that the percentages are very 
close to those under a theoretical normal curve 
with a standard deviation of 12. 

Only about four per cent of the cases showed 
differences of zero between their /’- and P-IQs. 
Considering the whole sample and the 
standardization process, the average /’-1Q and 
the average P-1Q both had to be 100 points. 
It will be rare, however, that any particular 
child will have his two IQs equal. About three- 
fourths of our subjects will show differences 
of four points or more, one-half of them eight 
points or more, and one-fourth of them 15 
points or more. Five per cent of children will 
show V’- and P-IQ discrepancies as great as 
25 points or more. 

It should be apparent by now that in our 
everyday clinical practice we must be extremely 
cautious in attaching any unusual meaning to 
differences in Verbal and Performance IQs, 
even when they are of considerable size. A 
difference may be clinically important, but not 
just because it is a difference. Other data must 
be adduced to permit attaching any import to 
a discrepancy even as big as 5, 10, or 15 points. 

The question of the origin of differences be- 
tween Verbal and Performance IQs. We re- 
marked earlier about the temptation to expect 
a zero difference between V- and P-IQs; this 
would be a fine universal norm against which 
to evaluate actual differences in the cases be- 
fore us in the clinic. It would be just as much 
of a logical error for us now to conclude that it 
is typical for children to be quite different in 
their verbal and performance abilities. No 
doubt some of these observed differences are 
due to real differences in abilities. However, 
we must never forget that the differences which 
we have been discussing have been in scores 
earned on tests, as expressed in IQs. Since tests 
are fallible, we must recognize that some part, 
and perhaps a considerable part, of the IQ dis- 
crepancies we observe within the individual are 
due to errors of measurement. Take an example 
of a ten-year-old for whom we have recorded 
a Verbal IO of 103 and a Performance IQ of 
95, a difference of 8 points of alleged superi- 
ority in ’. Is he really better on V than on P? 
According to Table 3, about one-half of our 
subjects will show smaller differences than 8 
points, and about one-half larger differences. 


However, on referring to Table 7 in the 
WISC Manual, we find that the standard 
error of measurement for Verbal 1Qs is about 
3 points and for Performance IQs about 5 
points. We must consider the possibility that 
our boy’s Verbal IQ is not 103 but as low as 
100, and that his Performance IQ is not 95 
but as high as 100. He may have no real dif- 
ference in the abilities tapped by these tests. On 
the other hand, maybe the real values should 
be recorded as 106 and 90, with a discrepancy 
score of 16 IQ points. 

Much as we want to eliminate errors of 
measurement, we shall still have to live with 
the plus or minus notion for a long time. This 
fact, of course, applies to all scores, not just to 
IQs or to WISC IQs. Lacking perfect meas- 
ures or not desiring to use tests which are long 
enough to provide more stable scores, we need 
to develop and exercise the habit of always 
thinking “plus or minus so much” when we 
note or discuss a test score. Since each of the 
scores in a pair being compared is subject to 
error, the possibilities of some found differences 
not being due to real differences in abilities are 
great. 


SOCIO-ECONOMIC VARIABLES AND GROU 
DIFFERENCES BETWEEN VERBAL AND 
PERFORMANCE IQs 


~ 


Certain stereotypes persist concerning the 
relative strengths of abilities in various socio- 
economic groups. Thus we hear it said that 
rural children are more “performance-minded”’ 
than “verbal-minded.” Or, that children from 
professional and executive environments not 
only tend to be brighter but are relatively 
stronger in verbal abilities than performance 
abilities [2].1 The data from the 2200 children 
in the standardization population can be sorted 
in various ways to permit study of some socio- 
economic factors. 

The urban-rural groups. Observation of 
Table 4 shows two facts. (1) In terms of 
number of cases, relatively more urban chil- 
dren have greater Verbal IQs than Perform- 
ance IQs, and the reverse is true of rural chil- 


1In reference [2] the socio-economic aspects of 
level of IQ are reported. The present paper is con- 
cerned only with the relation of socio-economic 
variables to differences between V- and P-IQs as 
observed in the children constituting the groups 
studied. 
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group of random subjects to show a difference 
between their Verbal and Performance IQs 
greater than 12-13 points of IQ, while in 
about two-thirds of the cases the differences 
will be smaller, from 0 to 12-13 points. 


The data force upon test interpreters a con- 
clusion of practical, everyday importance. 
While the theoretical average subject has a 
Verbal IQ equal to his Performance IQ, all 
the individual Johns, Marys, and Joes who are 
real and separate clinical cases can be expected 
to have relatively large discrepancies between 
their Verbal and Performance IQs. In fact, 
equal IQs will be rare. Furthermore, V will be 
greater than P about as often as P will be 
greater than /’. 

With this general point established, let us 
spread out more detailed data, partly to im- 
press upon ourselves the folly of over-interpret- 
ing small differences in obtained IQs and part- 
ly to give us background for understanding 
certain socio-economic aspects of differences be- 
tween Verbal and Performance IQs. 


TABLE 2 
STANDARDIZATION SAMPLE CLASSIFIED BY AGE 
Groups AND Direction oF IQ DIFFer- 
ENCES WITH MEDIAN DIFFERENCE 
For EAcH Group 


‘Verbal IQ 








Performance 








greater than IQ 
Performance IQs_ greater than 
IQ equal Verbal IQ 

Me- 

Age % of Median %of %of dian 

Group N cases Diff. cases cases Diff. 
 & 7 600 49 8 2 49 «8 
8-11 800 49 8 4 47 Q 
12-15 800 48 Q 4 48 9 
All Ages 2200 48 8 4 48 g 





There are no important age differences in 
discrepancy scores. Table 2 supplements Table 
1 and Figure 1, and shows that age bears no 
relation either to the direction or the size of the 
obtained discrepancies between Verbal and 
Performance IQs. For each age group, the 
numbers of cases in the V>P and P>V direc- 
tions of differences are about equal. The sizes 
of the median discrepancies are also essentially 
equal. 

In Table 2, the median of the differences is 
about 8 points, which bears a natural relation 


to the S.D. of 12-13 points observed before, 


being the approximate ratio of the probable 
error to the standard deviation in a normal 
curve. 


These interpretations of Tables 1 and 2 and 
Figure 1 are clear: (1) We can expect similar 
differences between V- and P-IQs among chil- 
dren at all ages who are examined with the 
WISC. (2) Differences between V- and P- 
IQs appear in each direction about equally 
often. (3) About one-half of the cases in a 
random run of children will have differences 
between their V- and P-IQs as great as 8 points 
or more. 


TABLE 3 


DISTRIBUTION AND CUMULATIVE PERCENTAGE OF D1s- 
CREPANCY Scores (REGARDLESS OF SIGN) FOR 
THE SAMPLE OF 2200 CHILDREN 
TESTED ON THE WISC 


Size of V and P 











Number of Cumulative 
Differences Cases Percentage 

35-4 14 100 

30-34 36 99 

25-29 68 98 

20-24 140 95 

15-19 284 88 

14 68 75 

13 74 72 

12 83 69 

11 88 65 

10 82 61 

g 117 57 

112 §2 

7 163 47 

6 114 40 

5 131 34 

4 132 28 

3 124 22 

2 144 17 

1 140 10 

0 86 4 
Total N 2200 





The foregoing data and conclusions are 
essentially an answer to the question: what is 
an expected difference in IQs on the V and 
P parts of the WISC? This general fact of 
large discrepancy scores, centering around 8 
points, can also be expressed in terms of cumu- 
lative percentages. Table 3 is a sort of table of 
norms. The table accumulates the percentage 
of cases with increasingly large differences, 
beginning with those of zero differences. The 
symmetry of data observed earlier permits us to 
estimate the percentage of differences in one 
direction, either positive or negative, by taking 
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one-half of the percentage shown in the table. 
It can be shown that the percentages are very 
close to those under a theoretical normal curve 
with a standard deviation of 12. 

Only about four per cent of the cases showed 
differences of zero between their /’- and P-IQs. 
Considering the whole sample and the 
standardization process, the average /’-IQ and 
the average P-IQ both had to be 100 points. 
It will be rare, however, that any particular 
child will have his two IQs equal. About three- 
fourths of our subjects will show differences 
of four points or more, one-half of them eight 
points or more, and one-fourth of them 15 
points or more. Five per cent of children will 
show V- and P-IQ discrepancies as great as 
25 points or more. 

It should be apparent by now that in our 
everyday clinical practice we must be extremely 
cautious in attaching any unusual meaning to 
differences in Verbal and Performance IQs, 
even when they are of considerable size. A 
difference may be clinically important, but not 
just because it is a difference. Other data must 
be adduced to permit attaching any import to 
a discrepancy even as big as 5, 10, or 15 points. 

The question of the origin of differences be- 
tween Verbal and Performance IQs. We re- 
marked earlier about the temptation to expect 
a zero difference between V- and P-IQs; this 
would be a fine universal norm against which 
to evaluate actual differences in the cases be- 
fore us in the clinic. It would be just as much 
of a logical error for us now to conclude that it 
is typical for children to be quite different in 
their verbal and performance abilities. No 
doubt some of these observed differences are 
due to real differences in abilities. However, 
we must never forget that the differences which 
we have been discussing have been in scores 
earned on tests, as expressed in IQs. Since tests 
are fallible, we must recognize that some part, 
and perhaps a considerable part, of the IQ dis- 
crepancies we observe within the individual are 
due to errors of measurement. Take an example 
of a ten-year-old for whom we have recorded 
a Verbal IQ of 103 and a Performance IQ of 
95, a difference of 8 points of alleged superi- 
ority in V. Is he really better on V than on P? 
According to Table 3, about one-half of our 
subjects will show smaller differences than 8 
points, and about one-half larger differences. 


However, on referring to Table 7 in the 
WISC Manual, we find that the standard 
error of measurement for Verbal IQs is about 
3 points and for Performance IQs about 5 
points. We must consider the possibility that 
our boy’s Verbal IQ is not 103 but as low as 
100, and that his Performance IQ is not 95 
but as high as 100. He may have no real dif- 
ference in the abilities tapped by these tests. On 
the other hand, maybe the real values should 
be recorded as 106 and 90, with a discrepancy 
score of 16 IQ points. 

Much as we want to eliminate errors of 
measurement, we shall still have to live with 
the plus or minus notion for a long time. This 
fact, of course, applies to all scores, not just to 
IQs or to WISC IQs. Lacking perfect meas- 
ures or not desiring to use tests which are long 
enough to provide more stable scores, we need 
to develop and exercise the habit of always 
thinking “plus or minus so much” when we 
note or discuss a test score. Since each of the 
scores in a pair being compared is subject to 
error, the possibilities of some found differences 
not being due to real differences in abilities are 
great. 


SOCIO-ECONOMIC VARIABLES AND GROUP 
DIFFERENCES BETWEEN VERBAL AND 
PERFORMANCE IQS 


Certain stereotypes persist concerning the 
relative strengths of abilities in various socio- 
economic groups. Thus we hear it said that 
rural children are more “performance-minded” 
than “verbal-minded.” Or, that children from 
professional and executive environments not 
only tend to be brighter but are relatively 
stronger in verbal abilities than performance 
abilities [2].1 The data from the 2200 children 
in the standardization population can be sorted 
in various ways to permit study of some socio- 
economic factors. 

The urban-rural groups. Observation of 
Table 4 shows two facts. (1) In terms of 
number of cases, relatively more urban chil- 
dren have greater Verbal IQs than Perform- 
ance IQs, and the reverse is true of rural chil- 


1In reference [2] the socio-economic aspects of 
level of IQ are reported. The present paper is con- 
cerned only with the relation of socio-economic 
variables to differences between V- and P-IQs as 
observed in the children constituting the groups 
studied. 
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TABLE 4 
Tue DrIrREcTION AND S1ze OF DIFFERENCES BETWEEN VERBAL AND PERFORMANCE IQs AMONG 


CHILDREN OF VARIOUS AGES CLASSIFIED AS URBAN 


AND RuRAL* 

















Urban 
Per Cent 
with Each 
Direction of 
Age Difference Difference 
Group N V>P V=P P>V Meant S.D. 
5- 7 365 52 3 45 +04 12.4 
8-11 486 52 4 44 +0.5 12.8 
12-15 476 53 5 42 +1.3 13.2 
All Ages 1327 52 4 44 +0.8 12.9 














Rural 

Per Cent 

with Each 

Direction of 

Difference Difference 
N yS>P Fear FSP Mean S.D. 
221 43 3 54 —0.6 11.9 
294 44 4 52 —0.7 11.2 
303 41 4 55 —2.2 12.8 
818 43 3 54 —1.2 12.0 





*The sample 


of 55 feebleminded cases is omitted because original residence was not recorded. 


+A plus sign shows the mean difference is in the direction of V > P. 


dren. (2) The mean discrepancy scores are 
about +1 for the urban children and —1 for 
the rural children. The standard deviations of 
these distributions of V and P differences are 
about 12-13 points in each group. Although 
the proportion of urban children with V-IQs 
higher than their P-IQs is significantly greater 
than the corresponding proportion among rural 
children, the means and standard deviations of 
the discrepancy scores for the two groups are 
virtually the same. The difference of 2 points 
between means is certainly not of any great 
importance even though it is in the direction in- 
dicated by the stereotype. It would be a mis- 
take for us in our clinical work to “make al- 
lowance” for rural and urban children in in- 
terpreting their differences in Verbal and Per- 
formance IQs. For all practical purposes, at 
least with the WISC, we should not expect a 
rural child to be more “‘performance-minded” 
than“verbal-minded.” 

The feebleminded group. Fifty-five cases in 
the sample were known to be classified as fee- 
ble-minded. Of these cases, 22 had V>P dis- 
crepancy scores, 3 showed no V and P differ- 
ence, and 30 had P-IQs greater than V-IQs. 
The mean difference was —2 points. Apparent- 
ly we would be unsafe in accepting as clinically 
important the somewhat common general- 
ization that the feebleminded in this age range 
are less feebleminded on performance tests. 

The parental occupation groups. Is there any 
clear-cut tendency for children of parents in the 
more verbal occupations to have higher Verbal 
than Performance IQs? Is there any tendency 
for farmers’ and laborers’ children to be re- 
latively more “performance-minded”? The 


sorting of the IQ discrepancy data into these 
socio-economic dimensions is shown in Table 5. 
The data in Table 5 may be evaluated in 


TABLE 5 
Tue DirRecTION AND SIZE OF DIFFERENCES BETWEEN 
VERBAL AND PERFORMANCE IQs AMONG 
CHILDREN CLASSIFIED BY 
PARENTAL OCCUPATION 





Per Cent with Each 
Direction of 
No. of Difference Difference 
Cases V>P V—P P>V Mean* S.D. 


Parental 
Occupation 





I. Professional 
and Semi- 
professional 176 35 3.1 
Il. Farmers and 
Farm 
Managers 45 2 


53 = -1.7 


III. Proprietors, 
Managers and 
Officials 
Clerical, Sales, 
and Kindred 
Workers 

V. Oraftsmen, 
Foremen, 

and Kindred 
Workers 
Operatives and 
Kindred 
Workers 
Domestic, Pro- 
tective and 
Other Service 
Workers 

. Farm Labor- 
ers, Foremen, 
and Laborers 
Miscellaneous 
(Unclassified) 


257 50 2 48 0.6 12.4 


IV. 


281 52 5 43 0.9 12.8 


400 46 6 48 11.7 


VI. 


868 47 4 49 12,8 


Vil. 


182 47 + 49 0.7 18.1 


311 44 4 562 -0.4 11.6 


Tx. 


53 47 0 58 -0.2 12.6 





*A plus difference means that the mean difference in 
IQ is in the direction of V > P. 
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terms of the proportions of positive and nega- 
tive discrepancy scores for each group, the size 
of the mean discrepancy scores, and the stand- 
ard deviation of these scores. Let us consider 
first the proportions of positive and negative 
discrepancy scores, that is, the proportion of 
children whose /-IQs are higher than their 
P-IQs and vice versa. By inspection of the 
data it appears that with the exception of occu- 
pational group I, the proportions V > P and 
P > V are about the same in each group. In 
group I, the professional parents category, 
there seems to be a decidedly higher percent- 
age of children with V-IQs greater than their 
P-1Qs. We can check this conclusion by apply- 
ing a statistical test of significance. In any one 
group, if only chance factors are operating, we 
would expect one-half of the group to have /’- 
IQs which are higher than their P-IQs and 
the other half of the group to exhibit the reverse 
situation. In Table 5 three columns are shown: 
V>P, V=P and P>V. It is reasonable to di- 
vide the /=P cases equally between the V >P 
category and the P > V category. This would 
leave us with two proportions, V > P and 
P > V,, which could be checked against the the- 
oretical probability of .50 and .50. If these 
computations are carried out, it will be found 
that the conclusion reached by inspection is 
confirmed. In group I only does the preponder- 
ance of V and P differences deviate significant- 
ly from the chance proportions. 

The mean discrepancy scores are all quite 
small. The largest mean score is found in 
group I, where the proportions are significantly 
different from the chance values. For all other 
groups, the mean differences are so small as 
to be of no practical significance. The direc- 
tions of the mean differences, however, are gen- 
erally consistent with the stereotypes of verbal 


and performance occupations. 

The standard deviations of discrepancy 
scores are very similar for all the groups in 
Table 5. Evidently the spread of scores is also 
independent of occupational classification. 

For all practical purposes we can conclude 
that, except for the children in occupational 
group | — those with professional and semi- 
professional backgrounds — there is no serious 
tendency for children in diverse occupational 
groups to show relative excellence in either 
verbal or performance abilities as measured by 
the WISC. 

Although other data have shown differences 
in the over-all mental Jevel of children with 
different socio-economic backgrounds, the pres- 
ent data should cause us to question the stereo- 
type that “verbal parents” produce children 
who show relatively better V than P abilities, 
or that “performance parents” produce chil- 
dren who show relatively better P than V abil- 
ities. 

In general summary of these socio-economic 
analyses, we can say that intra-group IQ dis- 
crepancies are much greater and of more signi- 
ficance than inter-group differences in the rela- 


tive sizes of V- and P-IQs. 


Received September 13, 1950. 
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WECHSLER-BELLEVUE SPLIT-HALF RELIABILITIES 
IN NORMALS AND SCHIZOPHRENICS 


WILSE B. WEBB ann HENRY DE HAAN 


WASHINGTON UNIVERSITY 


great deal of present-day research in- 
A to the nature of the psychoses concerns 

the results of psychological testing. A 
portion of this research uses tests standardized 
on normals, particularly the Wechsler-Bellevue 
Scales for the Measurement of Adult Intelli- 
gence. A review of this area of endeavor has 
been made by Rabin [10]. 

The validity of the test results in such re- 
search would seem to depend upon the relia- 
bility with which mental patients may be 
tested. Lindquist states: 

If a test is unreliable, that is, if it is not meas- 
uring anything consistently, it of course cannot be 
valid, that is, it cannot be measuring accurately 
what it is intending to measure. The coefficient of 
reliability theoretically sets an upper limit to the 
validity of a test, but it does not indicate how far 
below that limit the true validity lies. The coeffi- 
cient of reliability is most useful, therefore, in 
identifying poor tests, or for demonstrating that a 
test cannot possibly be high in validity [7, pp. 
207-208]. 


However, the problem of the reliability of tests 
when applied to psychotics has largely been 
overlooked [12]. 

The problem of the general reliability of the 
Wechsler-Bellevue scale has recently been con- 
sidered in some detail by Derner, Aborn, and 
Canter [2]. The article by these authors was 
primarily concerned with the reliability for 
normal subjects and used the test-retest meth- 
od. The authors found, for normal subjects, 
that the reliability of the subtests of the Wechs- 
ler scale ranged from .62 to .90, with four of 
the subtests in the .60’s (Arithmetic, Picture 
Arrangement, Digit Span, and Object As- 
sembly). Their conclusions may be summar- 
ized by the statement, “In many cases the de- 
gree of reliability is too low to warrant more 
than the most tenuous hypothesis. The scales, 
however, and particularly the full scale, can be 
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considered diagnostically dependable with nor- 


mal subjects” [2, p. 178]. 


The article of Derner, Aborn, and Canter 
cites with some completeness the few reliabil- 
ity studies which have been attempted on psy- 
chotic patients. These studies by Rabin [9, 
10] and Hamister [6] involve test-retest meth- 
ods. Although the reliability coefficients ob- 
tained by Hamister were considerably higher 
than those obtained by Rabin and comparable 
to those found for normal subjects, there was 
considerable evidence of unreliability as a fac- 
tor in testing. For a group of schizophrenics, 
for example, Rabin found five of the ten sub- 
tests with r’s below .40. 

One further study not included in the above 
review should be noted. Gilhooly [5] obtained 
the split-half reliability of four Wechsler sub- 
tests for 122 psychoneurotics. On these tests 
(Comprehension, Information, Similarities, 
and Vocabulary), reliabilities ranged from .56 
(Comprehension ) to .94 (Vocabulary). 

The present study differs from those re- 
corded above in one essential aspect. This study 
represents an attempt to estimate comparative 
reliability within a single testing situation be- 
tween psychotics and normals. The estimate 
was made on a group of psychotic patients 
(paranoid schizophrenics) and on a group of 
normal patients for comparative purposes. The 
split-half method of estimating reliability was 
used. 

It was felt most important to estimate re- 
liability within the single test interval for two 
critical reasons. Psychometric tests are used 
and are analyzed for any hypothetical pattern 
within, not between, test periods. Secondly, 
when psychotic groups are considered, the prob- 
lem of clinical change (either in the direction 
of improvement or debilitation) is such a crit- 
ical one that any difference in test results may 
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be a function of this factor and independent of 
the question of reliability of the test per se. 

The split-half method seemed the only feas- 
ible method to use to attempt to estimate re- 
liability within a single testing. The critical 
need for such an estimate, it is felt, far out- 
weighed the difficulties inherent in the appli- 
cation of the method, such as the shortness of 
the tests involved [5]. 

PROCEDURE 

The psychotic group was comprised of para- 
noid schizophrenics at the Missouri State 
Mental Hospital, St. Louis. The original test 
scores had been obtained for a separate study 
[14]. For a control group the test results of a 
group of normals were obtained from the 
American Red Cross Vocational Guidance 
Counseling Service, St. Louis. 


The psychotic sample consisted of fifty 
white female patients. The mean age was 43.8 
years, with a standard deviation of 6.97, and 
the mean IQ was 93.9, with a standard devia- 
tion of 12.56. 

The control popuplation was selected to 

TABLE 1 
NumpBer OF Items In EACH HALF-SusTestT AND 
THE MEANS AND STANDARD DEVIATIONS OF THE 
Suptest HALves 


No. of No. of 


Odd Even Normals Psychotics 
Subtest Items Items M 8.D. M 8.D. 
Vocabulary 21 21 10.78 2.87 9.40 2.96 


10.31 2.90 9.61 2.89 


Arithmetic 5 5 3.44 1.08 3.12 1.21 
2.84 1.62 2 1.36 
Information 13 12 5.20 1.96 5.06 2.24 


5.62 2.10 4.94 2.36 


Block Design 4 3 11.02 3.66 10.22 4.51 
6.50 2.93 6.76 3.51 


Similarities 6 $ 5.50 1.54 4.46 1.80 
5.38 2.39 4.58 2.42 


Comprehension 5 5 6.02 1.57 8.62 2.25 
5.18 1.89 3.26 1.96 
Digit Span i) 6 6.04 1.14 6.28 1.25 
4.31 1.28 4.66 1.24 

Picture 
Completion 8 7 4.40 1.22 3.32 1.49 
4.70 1.22 4.30 1.82 

Picture 
Arrangement 3 3 4.46 1.37 3.48 1.80 


3.40 2.05 2.48 2.10 





“"N = 60 except for Vocabulary (N — 86) and Digit 
Span (N — 49). 


match as nearly as possible the above popula- 
tion in age and IQ. The final selection con- 
sisted of fifty white female normals having a 
mean age of 37.6 years, standard deviation 
11.20, and a mean IQ of 97.8, standard devi- 
ation 11.07. Persons with known mental ab- 
normalities were, of course, excluded from the 
control group. It is apparent that the matching 
was more efficient for IQ than for age, since 
this was considered more important in terms 
of range. 

The Wechsler-Bellevue subtests were split 
into halves, the odd items composing one half 
and the even items the other half, except in 
the case of Object Assembly, Digit Span, and 
Digit Symbol. This is the method usually used 
in splitting tests [1]. The number of items in 
each half-subtest may be seen in Table 1. A log- 
ical examination of each split seemed to justify 
the essential demand of a split-half method, 
that is, equivalent halves. The means and 
standard deviation of the halves are also given 
in Table 1. 

The raw scores of the halves were then cor- 
related by the Pearson product-moment cor- 
relation method. The resulting reliability of 
the Digit Span Test may be considered a min- 
imum estimate of reliability, since the only cor- 
relation possible was between Digits Forward 
and Digits Backward, which presumably do 
not test precisely the same ability [13]. 

The reliabilities obtained for the Object As- 
sembly Test are not, strictly speaking, split- 
half reliabilities. Because the subtest contains 
only three items, the reliability represents the 
average of the intercorrelations of the items, 
which were transformed into z-values [3], 
which were then averaged and the result re- 
transformed into an average correlation coefh- 
cient, which was lengthened by the Spearman- 
Brown formula for triple length [4]. 

The reliability of the Digit Symbol Test 
could not be found due to the loss of the data 
in one of the groups. There is some doubt as 
to the meaningfulness of such data if they had 


been obtained [1]. 


RESULTS 


The uncorrected reliability coefficients pre- 
sented in Table 2 are all significant at the 1 
per cent level with the exception of five. Digit 
Span in normals and Object Assembly in psy- 
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TABLE 2 
CORRELATIONS OF THE SUBTEST HALVES, AND 
ReEviABiLiry COEFFICIENTS AND STANDARD ERRORS 
oF SUBTESTS 














Standard 

Corre- Reli- Errors 

Subtest lations abilities of Reli- 
abilities 
Nor- Psy- Nor- Psy- Nor- Psy- 

mals chotics mals chotics mals chotics 

Voeabulary a, a. oe, a ae. ae 
Arithmetic .69 .68 82 81 .05 -06 
Information .69 -72 -82 .84 .05 .04 
Block Design 61 16 76 .86 .03 04 
Similarities .59 .58 74 -173 .06 .07 


Comprehension  .36 .5T .63 -73 10 OT 
Object Assembly .20 .36 46 .64 12 -08 


Digit Span -28 87 44 .54 12 -10 
Picture 

Completion 27 .68 42 81 12 .05 
Picture 


Arrangement’ .17 46 .29 .63 13 .09 


N = 560 except for Voeabulary (N — 36), Object Assem- 
bly (N — 37), and Digit Span (N = 49). Object As- 
sembly value represents the average intercorrelations of 
the items. 





chotics are significant only at the 5 per cent 
level ; Object Assembly, Picture Arrangement, 
and Picture Completion are not significant at 
the 5 per cent level (Picture Completion is 
near significance). However, when corrected 
by the Spearman-Brown formula, the reli- 
abilities which appear in Table 2 are all sig- 
nificant at the 1 per cent level with the excep- 
tion of the value .29, the reliability of Picture 
Arrangement in normals, which is significant 
at the 5 per cent level. Since the reliability of 
the total subtest is of interest rather than that 
of the half subtest, it is reasonable to determine 
the significance after correcting for double 
length. 

It will be noted from Table 2 that the re- 
liabilities of the verbal subtests on the whole 
are greater than the performance subtests. 
This is more evident for normals than for para- 
noid schizophrenics. The highest reliability in 
both normals and paranoid schizophrenics is 
that of the Vocabulary subtest. These results 
are congruous with the results of Rabin [9, 
10] and Hamister [6]. The reliabilities of the 
verbal subtests are comparable in normals and 
paranoid schizophrenics. The reliabilities of the 
Vocabulary, Arithmetic, Information, and 
Similarities subtests are quite similar, those of 
Digit Span roughly similar, while only those of 
Comprehension show a large difference. 

The reliabilities of the performance subtests 


(and Comprehension) are not comparable, 
however, being higher, in general, in paranoid 
schizophrenics than in normals. 

The significances of the differences between 
the reliabilities for normals and for schizo- 
phrenics were obtained by transforming the re- 
liabilities into z-values. The differences be- 
tween the z-values were then tested by the 
standard error of the differences between 
z’s for the appropriate numbers [8]. Only 
two of the differences were found to be signi- 
ficant. The difference for Picture Completion 
was found to be significant at the 1 per cent 
level, and the difference for Picture Arrange- 


ment was found to be significant at the 5 per 
cent level. 


DISCUSSION 


These results, showing the higher reliabili- 
ties of psychotics in performance tests, are quite 
surprising in view of the fact that one would 
logically expect paranoid schizophrenics to ob- 
tain test reliabilities either similar to or lower 
than normals. It is difficult to believe that the 
results could be an artifact caused either by 
extraordinary data or by the method of calcu- 
lation. 

That the data are representative is indicated 
by the fact that, when the total subtest scores 
are compared with those of normals, the sub- 
tests on which the paranoid schizophrenics ob- 
tained lower scores agree generally with 
Wechsler’s indicators of schizophrenia. More- 
over, Rabin obtained a low reliability for the 
comprehension test by a retest method. Most 
importantly, the reliabilities of the subtests may 
be compared with those reliabilities obtained 
by Gilhooly using the same method [5]. When 
this is done, the normals differ from Gilhooly’s 
group only in the second decimal place. 

The method of analysis is a common method 
of estimating reliability and in view of the na- 
ture of the test the odd-even split seems to be 
the most logical method. It is quite true that 
the resultant halves are not equa! in all cases 
and that there are many ways of splitting 
halves. Although an inspection of Table 1 will 
reveal that the means and Standard Deviations 
are not identical in some of these splits, high 
reliabilities are obtained in some cases where 
the halves are not nearly equal and in which 
there are few items (Block Design). More- 
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over, the absolute magnitude of scores, as re- 
presented by their means, should not affect 
their correlation. If one obtains a high score in 
one half of a test, he should also obtain a high 
score in the other half. 

It is surprising to find such low reliabilities 
on several of the subtests of the Wechsler- 
Bellevue with normals, but they are comparable 
to the data reported by Derner, Aborn, and 
Canter [2]. If the reliabilities are actually so 
low, it is permissible to question if such subtests 
are valid and if any kind of predictions can be 
made from them, such as to distinguish normals 
from psychotics and to differentiate classes of 
psychotics. 

When the total subtest scores are computed 
by the addition of the halves and a comparison 
is made between normals and paranoid schiz- 
ophrenics, it may be seen that the subtests in 
which the paranoid schizophrenics are inferior 
to normals are precisely the ones in which they 
have higher reliabilities. One is tempted to 
speculate upon the reasons. A higher reliability 
indicates more consistent responses. Perhaps 
this greater consistency is due to a lack of 
motivation which causes the paranoid schiz- 
ophrenic to fail in a test situation when he is 
not confident of his success. In contrast the 
normal person having higher motivation will 
take chances, and while this contributes to his 
higher score, it makes for less consistency and 
hence lower reliability. In this light, the higher 
reliability would be attributed to either a lack 
of motivation, or a lower degree of confidence, 
or perhaps both. If such is the case, one wonders 
if some use might not be made of these results 
in diagnosis. 

Above all, these results indicate a need for 
more extensive studies of test reliability. The 
data on normal populations should be extended. 
If such low reliability estimates hold for nor- 
mal groups, efforts to increase the reliability of 
the tests seem in order. Estimates of reliability 
also should be made for other types of psy- 


choses. Such estimates and differences may yield 
considerable insight into the behavior charac- 
teristics of the disorders. 
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TRANSFERENCE IN CLIENT CENTERED THERAPY 
AND IN PSYCHOANALYSIS 
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HEN we who practice psychotherapy 

ask ourselves what it is that we do or, 

more properly, what it is that takes 
place in the personal-social interaction between 
patient and therapist, we generally have to 
admit much more puzzlement than certainty. 
True, some patients improve, some, even, may 
be cured. But others are not helped, and some 
may be worse as a result of our efforts. What 
actually takes place in these several cases is, at 
best, only partially understood. 

In any event, it seems clear that the thera- 
peutic process is a human relationship, a per- 
son-to-person affair in which the patient at- 
tempts to work out some improvement by 
means of various operations in which he en- 
gages—with, through, or against the therapist. 

In the course of the dialogue which occupies 
much of the therapeutic hour many things 
happen, not the least important of which are 
the feelings which are generated in both the pa- 
tient and the therapist—feelings of each to- 
ward the other and toward himself. That 
these feelings are sometimes positive, sometimes 
negative, and often ambivalent is to be expected, 
for we have here two real, flesh and blood 
people interacting with each other in a special 
and intimate sort of way. 

Of special interest are those feelings of the 
patient which, instead of being normal, healthy, 
reality-oriented responses to the real person- 
ality and real behavior of the therapist, are, 
rather, irrational, stereotyped 1esponses which 
were characteristically made by the patient to 
some important person (usually a parent) in 
his earlier life and are now repeated in toto as 
responses to the therapist, even though they 
may be totally inappropriate as responses to 
what the therapist is actually doing or saying. 
“The patient sees in his analyst,” writes Freud, 
“the reincarnation of some important figure 
out of his childhood or past, and consequently 
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transfers onto him feelings and reactions that 
undoubtedly applied to this model” [4]. Not 
all reactions of patient to therapist are to be 
included in the concept of transference, or the 
transference neurosis as Freud called it, but 
only, according to Alexander and French, such 
“repetitions of earlier reaction patterns as are 
neurotic—that is only those that are irrational 
or inappropriate in the present real situation” 
fl}. 

The transference relationship in both its 
positive and negative phases or forms has been 
recognized and treated at length by psychoan- 
alytic thinkers and teachers—as has its recip- 
rocal, the counter-transference of therapist to 
patient [1, 2, 3, 4, 5, 6, 8]. In fact, the “anal- 
ysis of the transference” is one of the most im- 
portant and frequently used tools in the ana- 
lyst’s kit. Our concern here is with the ques- 
tion of how transference may differ in client 
centered therapy from the transference which 
develops in analysis and how the two therapies 
differ in their handling of the problems in- 
volved. 

The analyst is aware of the process of trans- 
ference, expects it, and may even direct his ef- 
forts to encouraging its development. He has 
studied its formation in numerous cases and is, 
or at least tries hard to be, aware of its possible 
uses and dangers. He attempts to aid the pa- 
tient by interpretation or explicit statement to 
become aware of his projections and to use this 
awareness as a tool for producing, first, greater 
understanding of self and, later, emotional 
growth. 

The client centered therapist may also be 
aware of the existence of both transference and 
counter-transference. His method, however, 
differs from that of the analyst in several im- 
portant respects. He is required to reflect the 
feelings expressed by the patient, to restate 
them, to clarify them. He is not to offer inter- 
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pretations. He inust not appear to evaluate or 
judge the patient, the patient’s feelings, or his 
behavior. It might seem that the client centered 
therapist could only assume passively the role 
thrust upon him by the patient. If the patient 
projects upon the therapist a set of attitudes 
and behavior patterns which are a distillation 
of the patient’s own (conscious and uncon- 
scious) conception of what one of his parents 
was like to him, the therapist is to state with a 
rising inflection, “You are afraid that I will 
not approve of what you propose to do?” or 
whatever other statement is called for by the 
therapist’s guess as to what feelings the pa- 
tient’s words are seeking to express. He will 
not offer the interpretation that the patient is 
now feeling and reacting to the therapist in the 
same manner that he used to feel and act to- 
wards his mother or father. All that he says is 
calculated to be a reflection of the feelings 
currently being experienced by the patient and 
an expression, in straightforward fashion, of 
his own effort to understand and accept the 
patient as he is. 

Rogers [7] recognizes that transference at- 
titudes exist to some degree in almost all thera- 
peutic relationships, but maintains that whether 
or not these attitudes will develop into an or- 
ganized, pervasive, transference relationship or 
transference neurosis will depend upon what 
the patient experiences when the therapist re- 
sponds to his expressions of transference atti- 
tudes. The argument is that, if the patient’s ex- 
pressions of transference attitudes are met with 
interpretation, if, in other words, the therapist 
shows the patient that he understands him 
better than the patient understands himself, 
then feelings of inferiority, incompetency, and 
dependency upon the therapist are bound to 
develop. And these, in turn, will lead to the 
growth of a transference relationship. If, on 
the other hand, the patient’s expressions of 
transference attitudes are met, as are all other 
patient statements, simply with efforts to 
understand and to accept, there will be little 
or no basis for the development of such a rela- 
tionship. On this point analysis and client cen- 
tered therapy differ sharply. In the words of 
Fenichel, “The analyst’s reaction to transfer- 
ence is the same as to any other attitude of the 
patient: he interprets” [2]. In other words, he 
tells the patient what, in terms of the transfer- 


ence concept, the patient is doing. What hap- 
pens next will depend on many factors, not ex- 
cluding the manner in which the interpretation 
has been expressed. Rogers, paraphrasing 
Fenichel, has written, “The client centered 
therapist’s reaction to transference is the same 
as to any other attitude of the patient: he re- 
flects” [7]. 

What, then, happens in the patient when his 
expression of a transference attitude is met sim- 
ply with reflection? The patient has projected 
many things upon the therapist. Many of these 
projections have been from his past fears, frus- 
trations, loves, and hates. He attempts, for ex- 
ample, to put the therapist in the role of an 
unappreciating, disapproving, punishing father. 
But the client centered therapist does not as- 
sume that role. He points out that the patient 
has made a statement which seems to have the 
meaning that he, the therapist, disapproves and 
wishes to punish the patient. But he does not 
offer to connect that with any previous events 
in the patient’s life. Moreover, the attitude of 
the therapist is, in reality, neither approving 
nor disapproving. Were he, in fact, the pa- 
tient’s father, he might chide the patient, scold 
him, ignore him, or even chastize him. But the 
client centered therapist does none of these 
things. He continues to reflect the patient's feel- 
ings, and, in so doing, he communicates to the 
patient his own deep and genuine interest in 
him. This communication, while never express- 
ly stated in so many words, is, however, repeat- 
ed many times between the lines, so to speak, of 
what the therapist says, and it must be a dull 
or distorted patient who does not become 
aware, sooner or later, of the contrast between 
the actual attitude of the therapist and the at- 
titudes which he has been attributing to him. 
In fact, says Rogers, this happens quite soon in 
most cases and, therefore, real transference re- 
lationships seldom develop in cases handled in 
the client centered way. 

The expressed attitudes of the client centered 
therapist are neither approving nor disapprov- 
ing. They are neither rewarding nor punishing. 
They are, rather, the attitudes of an interested 
person seriously trying to understand but never 
expressing a judgment or an evaluation. In ef- 
fect the therapist has depersonalized himself, 
thus making of himself one who offers no 
threats to the patient’s security while at the 


same time offering no peg on which the patient 
might hang his neurotic stereotypes. The evi- 
dence of his own senses is contrary to the hy- 
pothesis that the therapist is judging him. 
When, in this framework, the patient feels 
himself judged—and all the therapist has ever 
done has been to clarify, understand, and ac- 
cept—the patient may be forced to see the 
source of the projections in himself. In some 
cases the patient may go further to see the 
origins of these projections in some of his re- 
lations with his parents. When this is done we 
may perhaps speak of “‘se/f-analysis of transfer- 
ence.” Just what does happen in the longer 
client centered cases seems still to be an open 
question. Does the transference relationship 
fail to develop, as is maintained by Rogers? Or 
does the client centered process force a develop- 
ing transference relationship to disguise itself 
from both patient and therapist ? Or what? 

With these thoughts in mind I made a study 
of the verbatim protocols of five cases handled 
by client centered therapists (Cases Int, Ban, 
Dem, Far, and Que from the Counseling 
Center at the University of Chicago). None of 
them was a long case. They ranged from three 
to nine interviews and from two hundred to 
six hundred client responses per case. Of the 
nineteen hundred client responses involved, the 
responses referring in any direct way to the re- 
lationship between patient and therapist num- 
bered only 8, 8, 9, 17, and 19 respectively in 
the five cases. We would have to say, there- 
fore, that there is little or no quantitative evi- 
dence for the existence of a transference rela- 
tionship in these five cases. When we survey 
the meager data qualitatively, however, things 
look somewhat different. In one case which 
lasted only seven interviews client responses 
included the following: 


II. (second interview) “. . .It seemed to me 
that—that as we were talking along, that you, not 
only as a counselor, but you as an individual, were 
getting sort of excited about this thing too, just as 
I was. And that, well, at times you were no longer 
a counselor to me, but you were just another per- 
son that I was talking over this problem with.” 

III. “. . .as we go along, every so often, I sort of 


look up and see a certain twinkle in your eye 
which was enough to let me know that you're here 
rather than someplace else.” 

VII. “. . .you’re not just a counselor, but you're 
a person. And, inasmuch as I know that you're a 
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person, there are times when, well, I feel you just 
hold back on me.” 


In another case, which also lasted but seven 
interviews, client remarks included the fol- 
lowing: 

III. “. . .that’s very pretty. . .” (pointing to the 
counselor’s dress). 

IV. “As a matter of fact, a peculiar thing,—I 
hate to admit it—[laughs] is that, except in the last 
two interviews, I don’t believe I’ve been much con- 
cerned with your reflections. You probably realize 
I’ve been moving pretty fast, and somewhat run- 
ning up the middle of your spine at times without 
really, uh, knowing it, desiring to go ahead. A 
sort of manic euphoria [laughs]. But I guess I’ve 
done enough to you today.” 

Vv. “. . .1 wish I could phrase some of these 
things like you do... .” 

VII. “You mean you have to sit and listen 
to me for fifteen more minutes? Boiling over like 
this? Not saying much of anything?. . . I think 
I have been able to pick up rather subliminal cues 
.. .Lof]. . .boredom. . .Well, not exactly bored [om], 
but there wasn’t much doing. . . .I wouldn’t say 
that you were bored because I have no way of 
knowing. You look very pleasant, at least during 
the, the hour here, and, uh, if you are bored, I 
mean, that’s tough luck. [Both laugh.] Kind of 
tough. I mean I never had a woman in a position 
where she couldn’t say anything before. Maybe I 
should have exploited the situation more round- 
a, 


Whether one sees transference attitudes or 
a transference relationship between the lines or 
below the surface of some of these remarks will 
depend, perhaps, on some fundamental aspects 
of the personality theory one holds. I am in- 
clined to guess that, at least in the second case, 
a transference relationship may have been 
formed, or that it would, if the case had been 
continued a good deal longer, have come out 
in much clearer form than it could in a mere 
half-dozen interviews. Rogers [7] has indicat- 
ed that, in their longer cases, “transference at- 
titudes are more frequent and more noticeable” 
than in the shorter cases. The question remains: 
“What about the transference relationship in 
the longer client centered cases?” Rogers stout- 
ly maintains that the transference attitudes 
may develop, but that the very nature of the 
client centered process prevents the develop- 
ment of a transference relationship. The prob- 
lem seems clear. More of us must study, in de- 
tail, the protocols of some of the longer cliext 
centered cases, seeking the data that will throw 
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more light on the question of whether or not 
transference attitudes do develop and, if they 
do, under what conditions, and how they 
operate in the therapeutic process. 

Received May 15, 1950. 
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THE GENERAL COUNSELOR: MUST HE BE 
ECLECTIC? 


DUGALD S. ARBUCKLE 


BOSTON UNIVERSITY 


HE general counselor who is oriented to 

the nondirective point of view finds it 

extremely difficult to accept eclecticism 
as the ideal method of counseling. He is faced 
with a great diversity of problems, and while 
he is acutely aware of the limitations of the 
nondirective point of view, he may feel that 
eclecticism is a challenge to his integrity. Part 
of the basic philosophy of the nondirective 
counselor is a belief and a faith in the capacity 
of the individual to solve his own difficulties. 
This basic belief makes it extremely difficult 
for a nondirective counselor to change his tech- 
nique and his approach. It is almost impossible, 
for example, for a nondirective counselor who 
is striving to see the client as he sees himself, to 
turn around and be the diagnostician who is 
not going along with the client, but is, rather, 
trying to find the meanings behind the client’s 
statements and the causes of his difficulties. 

It is difficult to discuss eclecticism in counsel- 
ing without understanding of what is meant 
by the term counseling. When counseling is 
viewed as an all-inclusive affair practically syn- 
onymous with guidance, it is difficult to see 
how any general counselor could be anything 
but eclectic. If this broad concept of counseling 
is accepted, a student has been counseled when 
he is told that English 2, not English 3, is the 
required English course for those students who 
plan to go to college. Similarly, practically any 
problem is a problem that requires counseling, 
so that when a perfectly happy and adjusted 
John asks the simple question, ““Where can I 
go to get some information about Boston Uni- 
versity?” he will experience counseling just as 
will the desperate Mary, who talks about 
suicide because she has been humiliated by her 
former boy friend. 

The chief difficulty with this omnibus sort of 
definition is that it takes in so much that it loses 
all meaning. The teacup reader, the race-track 
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bookie, Mrs. Jones down the street, Dr. Smith 
the dentist, the sympathetic bartender—all are 
counselors. It would seem that practically any- 
one who helps a person in any way is, according 
to this concept, a counselor. 

On the other hand, there are those personnel 
workers who think of counseling in terms of 
therapy—in terms of an interaction between 
counselor and client. The complexity of the 
emotional disturbance requiring counseling 
must be such that it can be relieved only by the 
development of greater insight on the part of 
the client, and this insight is the result of the 
interaction between counselor and client. In 
some situations the client does not become more 
rational because of counseling but because an 
external block has been removed by the 
counselor. Often, of course, environmental 
manipulation is ineffective, and quite frequently 
environmental manipulation and counseling go 
hand in hand. In giving information about the 
availability of a scholarship, the counselor may 
not be counseling, but if he finds a girl whose 
pride refuses to allow her to accept the needed 
scholarship, he may face a counseling situation. 

The writer views counseling as the process 
which enables the individual to accept and use 
information and advice and to accept an un- 
changeable environment without being over- 
come by it. Thus when the client gets to the 
point where he can rationally discuss possible 
choices, he is no longer in need of counseling. 
If we are to accept this concept of counseling, 
if the process of counseling is to be narrowed 
down to the actual interaction between coun- 
selor and client, then the major question with 
regard to eclecticism simply becomes: Can one 
be eclectic? 

The counselor who has no particular faith or 
belief in the capacity of the client may be try- 
ing a nondirective approach, but at the first 
sign of any difficulty he will probably swing in- 
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to a more directive role. This may be because 
he sincerely feels that this is now the best ap- 
proach, but there is no doubt that many times 
it is simply because it is the only thing he can 
do. He has neither the belief nor the skill that 
is necessary if he is to continue in the nondi- 
rective role. 


The so-called general counselor in a school 
or college is most interested in the question of 
the place of eclecticism, since he is the individ- 
ual whose clients bring in a multiplicity of prob- 
lems which range from the very simple to the 
extremely complex. The cli: .-1 counselor may 
be fairly sure that most of his clients are in 
need of counseling, but many of the general 
counselor’s clients are not in need of counsel- 
ing. Many are quite able to make use of infor- 
mation and advice, and for many others a prob- 
lem is solved by a slight environmental change. 
When John Todd steps into the counselor’s of- 
fice, however, the general counselor very often 
has no advance indication of the depth of this 
individual’s problem. And this is the time when 
the counselor is sorely tempted to take the easy 
road of eclecticism — not because it is what 
should be done, but because it is the easiest ap- 
proach. 


The following cases are common examples 
of the nondirective general counselor in action. 
If we accept the narrower concept of counsel- 
ing as given in this paper, some of these prob- 
lems are solved without counseling, and in no 
case is the counselor being eclectic. In other 
situations, however, it is a case of emotional 
stress, and the problem can only be solved by 
the interactive process between counselor and 
client. In such cases the counselor must make 
his choice. He can follow one method because 
he feels it is the most effective procedure, he 
can refer the client to another counselor be- 
cause he feels the most effective method may be 
one which he cannot use, or he can become 
eclectic like the jack-of-all-trades. 

1. Mary Johnson comes into the office and indi- 
cates her despair over her lack of financial re- 
sources. She has no money, and she cannot earn 
enough to pay her tuition for the next semester. The 
couneslor soon finds out that she has not made use of 
an available scholarship, and he makes an appoint- 
ment with the office in charge of scholarships. By 
the afternoon Mary has the scholarship, and as far 
as can be determined by periodic contacts with Mary, 
the problem has been solved. She appears to be 


happy, she gets along well with her fellow stu- 
dents and teachers, and she does good academic 
work. The problem here occurred because of lack 
of knowledge. The counselor supplied it, and the 
problem was solved. The girl was under emotional 
stress because of lack of knowledge, but when the 
knowledge was supplied she made use of it and 
solved her problem. 

2. Bill Gregory tells the counselor that he 
wishes to change his major field of study from 
secondary school mathematics to elementary edu- 
cation. The counselor reflects the general question, 
and Bill talks easily, giving excellent intellectual 
reasons why he wishes to change his major. The 
counselor cannot be sure, but he feels that Bill 
wants intellectual information and that he can use 
it. He gives him the desired information and 
checks the university bulletin with him. Bill is ac- 
cepted in the elementary education field, and as 
far as can be determined he does a good job. 

3. Joe Earl comes into the counselor’s office in 
an obviously angry mood. He denounces a profes- 
sor, says he is sick to death of him, and he can’t 
stand him another day. He has just got to change 
his major field of study or drop out of the uni- 
versity. In this obvious counseling situation the 
counselor reflects the negative attitudes, and at the 
end of half an hour Joe is no longer talking about 
the faculty member but is referring to a variety of 
other difficulties in a negative and hostile manner. 
At the end of the hour another appointment is 
made, and Joe returns later for further counseling. 


4. A faculty member tells the counselor that 
Joe Martin does not participate in any class dis- 
cussions and that he appears very withdrawn. He 
says that he has suggested to Joe that he drop in to 
see the counselor. Several weeks pass without any 
sign of Joe. The counselor's assistant telephones 
Joe and in an informal way asks him is he would 
care to come in and talk to the counselor about his 
general progress in the school. Joe indicates that he 
will, and an appointment is made. He does not 
keep the appointment. Further consultation with 
faculty members indicates that he does need im- 
mediate attention. The counselor finally gets him 
into the office, but his verbalization is limited to a 
weak “yes” or “no.” Referral is made to one of the 
university psychiatrists. 

5. Betty Ross comes into the counselor's office 
with a slightly belligerent attitude because of 
what she feels to be unfair treatment. She has re- 
cently been told of a speech requirement for grad- 
uation, and since she is now a senior she feels that 
it is very unfair that her graduation should be held 
up because of this new requirement. The counselor 
realizes that this is a case of misunderstanding, 
since the new regulation was to apply only to new 
students. He checks with the chairman of the com- 
mittee in charge of such affairs, and Betty leaves 
the office relieved of what she thought was an ex- 
tra burden. Her tension and distress were because 
of a misunderstanding. When this was corrected, 
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the problem was solved. 


6. Susan Brown comes into the counselor’s 
office and starts to talk, on an intellectual plane, 
about her below-average grades. The counselor 
knows that Susan is intellectually superior to most 
of her peer group, and he also knows from previ- 
ous conversations that she has a very unhappy 
home situation. He uses a nondirective approach, 
and Susan soon veers around to her basic problem 
and talks rather bitterly about the injustice of her 
home situation. Before the hour is up, however, she 
has shown some signs of insight into her situation, 
and she asks the counselor for another appointment. 

7. Harold Dean strides into the counselor’s office 
and tells him that he is sick of being pushed 
around by the school, and he is completely con- 
fused and hasn’t the faintest idea of what he wants 
to do in the future. The counselor attempts to use 
a nondirective approach, but Harold belligerently 
tells. him that what he wants now is advice on 
what he should do, and if he doesn’t get that ad- 
vice he’ll go elsewhere. The counselor structures 
his general position, but the client rejects this com- 
pletely and indicates again that what he wants is 
advice on what he should do. The counselor tells 
Harold that another counselor could probably be of 
more assistance, and a telephone appointment is 
made the same day with another counselor. 


8. Mary Saul asks the counselor for some ad- 
vice with regard to her sister. As Mary talks the 
counselor begins to feel that she is talking about 
herself, but her conversation continues on an intel- 
lectual, third-person basis. The counselor gives the 
desired information but tries to make it such that if 
Mary is talking about herself she will be able to 
make use of the information. He also leaves the 
door open so that Mary will feel free to return and 
talk further with the counselor about her “sister.” 


9. Jane Dodds comes in to talk to the counselor, 
who is also her teacher. She shows marked hostility 
toward the counselor and indicates that she feels 
he has treated her unfairly in the matter of a grade. 
The counselor accepts her negative feeling, and, 
after a half hour of a “letting out” period, Jane 
says that she probably did not do as well after all 
as she had at first thought, and she asks the coun- 
selor to tell her just where she stood with regard 
to assignments and the final examination. The 
counselor gives her the desired information. She 
appears to accept it, and as she goes out of the 
counselor’s office she says, “I guess I really knew 
that I wasn’t so hot but I didn’t want to admit it 
to myself.” 


From the viewpoint of the general counsel- 
or who leans toward the nondirective point of 
view, the following would appear to be worthy 
of some consideration as principles of action: 

1. In an obviously intellectual situation the 
counselor will give the desired information. 
He will differentiate clearly between informa- 
tion and advice. 


2. In many circumstances the solution of a 
problem will depend upon environmental 
manipulation, and the counselor will do what 
he can to see that this is carried out. Very often 
the solution of the problem will require both 
environmental manipulation and counseling. 

3. In any situation where there is the slight- 
est notion in the counselor’s mind that there is 
an emotional difficulty behind the intellectual 
approach, he will reflect the general expressed 
problem and on certain occasions make use of 
intellectual sawdust to continue the conversa- 
tion. That is, the conversation will be on an in- 
tellectual level, but it will be in a strictly neu- 
tral basis and will not particularly direct the 
client one way or another. The client may then 
go into deeper emotional area, and the nondi- 
rective approach may be used effectively. On 
the other hand, the counselor may have to 
structure his general position, and if the client 
does not wish to accept the counselor’s position 
he will be referred to someone else. From the 
counselor’s point of view, this referral will be 
a matter of ethics rather than of bias. He sim- 
ply feels that he is ineffective in a more direc- 
tive role, and it may be that it is contrary to 
his personal philosophy. 

4. When a student is referred rather forcibly 
to the counselor, a neutral intellectual dis- 
cussion or a sharing of experience may be nec- 
essary in order to establish rapport. It may be 
that rapport cannot be established, and referral 
will be necessary. If rapport is established, it 
might then be followed by the offering of in- 
formation, by assistance in the changing of the 
environment, by counseling, or by referral. 

5. The counselor will do his utmost to aid 
the student in his struggle for self-under- 
standing, but in the matter of diagnosis and 
prognosis he is keenly aware of his own inade- 
quacy. Referral, however, is often impossible, 
There is simply no one to whom the client can 
be referred. If this is the case, if the counselor 
represents the client’s last hope in the way of 
professional assistance, should he, despite his 
awareness of his own inadequacy, advise the 
client as best he can? This is a serious question, 
and it cannot be answered lightly. The basic 
and unanswered question probably is: How 
can we put to most effective use the thirty 
minutes that we have with troubled John 
Todd? 


Received April 10, 1950. 
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ATTITUDES TOWARD SELF AND OTHERS: A BRIEF 
QUESTIONNAIRE REPORT 


E. LAKIN PHILLIPS 


GEORGE WASHINGTON UNIVERSITY 


ANY clinicians and counselors have 

noted the apparent relationship be- 

tween attitudes toward one’s self and 

attitudes toward others, as these attitudes have 

been expressed by clients during counseling and 

psychotherapeutic interviews. Recently, Rogers 

[7] and two of his students [9, 10] expressed 

this relationship in terms of Pearson product- 

moment r’s in the +.50’s and +.60’s. To the 

writer’s knowledge this is the first attempt in 

the literature to quantify the self-others rela- 

tionship as it is expressed by clients undergoing 
psychotherapy. 

Other therapists, however, have made simi- 
lar observations, but of a qualitative nature. 
Frieda Fromm-Reichmann has remarked “.. . 
because one can respect others only to the ex- 
tent that one respects oneself. Or to put it dif- 
ferently, one can love others only to the extent 
that one loves oneself” [4, p. 167]. And again, 
“Where there is low self-esteem there is .. . 
low esteem of others and fear of low apprecia- 
tion by other people” [4, p. 168]. Much of the 
discussion in Fromm’s book [3] is centered 
around “self love” and relationship with others, 
much to the point that self-references in gener- 
al are related to references toward others, 
whether they are expressed in favorable or un- 
favorable terms. Allen [1] has expressed him- 
self similarly in his discussions of therapy with 
children. Many of our casual, everyday obser- 
vations of people have led us to suspect that the 
i: dividuals who are prone to express negative 
atcitudes toward others, to be constant fault- 
finders, also harbour negative self attitudes. 
Conversely, those who seem to like and respect 
themselves are inclined to be positive, at least, 
in their attitudes toward others and to be gen- 
erally less critical of those around them. 


The work of Rogers and his students in re- 
gard to self-others attitudes was carried on 
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among clients receiving psychotherapy; the 
quantification of this relationship was derived 
from judges’ ratings of the negative and posi- 
tive self- and others-references as expressed by 
clients during recorded interviews. The present 
investigation is an attempt to carry this work 
one step further but in a somewhat different di- 
rection. 
PROCEDURE 


The descriptions of self-others attitudes as 
reported by Sheerer [9] were converted into 
simple statements to form a questionnaire of 
50 items, with 25 items referring to self atti- 
tudes and 25 items refrring to attitudes toward 
others. Each item of the questionnaire was 
answered by the respondents on a five-point 
scale—A, B, C, D, or E—where A = “rarely 
or almost never true for me,” B = “sometimes 
but infrequently true for me,” C = “‘occasion- 
ally true for me,” D = “very often true for 
me,” and E = “true for me all or most of the 
time.”’ An arbitrary weighting system was as- 
sigaed to each of these responses, beginning 
with one point for A, two for B, etc. to five 
points for E. An individual’s total score for 
each of the two series of items, which were 
presented randomly, was computed separately 
according to this system. The subjects in all of 
the populations reported on below took the 
questionnaire anonymously. The subjects were 
told that the reasons for the questionnaire were 
to help the writer in forming personality test 
items and to study the phraseology of the items 
presented.* 

Five sample items from each of the two sec- 


1The test-retest reliability of the present ques- 
tionnaire, after a five-day time lapse, was +.84 
-+-.044 for the 25 questions regarding Self, and +.82 
+.049 for the 25 questions regarding Others. This 
part of the investigation was done on 45 previously 
unstudied general psychology students. In this in- 
stance the questionnaire was not administered 
anonymously. 
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tions of the questionnaire are reported below. 
Five items pertaining to attitudes toward 
others are the following: 

When others make an error in my presence I am 
almost certain to point it out to them. 


I find it hard to accept some minority group 
members as equals. 


One soon learns to expect very little of other 
people. 


Some people are always trying to get more than 
their share of the good things in life. 


A small group of obnoxious people stir up most of 
the troubles which we read about in the papers. 


Five items pertaining to attitudes toward 
self are the following: 
I feel inferior as a person to some of my friends. 


I feel that I have very little to contribute to the 
welfare of others. 


I feel the need to make excuses or apologies for 
my behavior. 

Although people sometimes compliment me, I feel 
that I do not really deserve the compliments. 

I think I would be happier if I didn’t have cer- 


tain limitations. 

The hypotheses under investigation in this 
questionnaire study were that self-others atti- 
tudes are a facet of personality structure (the 
importance of which must be determined by 
further research), that such attitudes can be 
elicited directly via a question-and-answer 
technique, and that such attitudes are related 
to each other toastatistically reliable extent in 
all sections of the population that can respond 
to the questionnaire medium. The main interest 
was in determining whether the self-others at- 
titudes bore a similar relationship to each other 
when studied in a non-clinical setting via a 
questionnaire technique as they did in the more 
qualitative, observational setting of the clinic. 


For more general interests, too, the study 
was thought to be of importance. The recent 
emphasis that has been given to the study of the 
“self” [5] and the “self-system” [11], together 
with new trends in psychotherapy [1, 6, 11], 
all seem to point toward the study of the in- 
dividual’s perceptions of himself particularly as 
these perceptions and evaluations relate to at- 
titudes toward others. It is at least implicit in 
studies of racial attitudes—‘prejudice’’—that 
one’s own shortcomings and dislikes are pro- 
jected in one way or another onto others (in- 
dividuals, ethnic groups, nations, etc.) [2]. 
Sears’ study of projection [8] further illus- 


trates the projection of self attitudes onto 
others. 


RESULTS 


The questionnaire was first given to a group 
of 48 college students enrolled in a general psy- 
chology course during the 1949 summer session 
at George Washington University. This group 
was composed mostly of older students who 
were part-time, summer school students not 
representative of typical freshman-sophomore 
groups one generally finds in introductory 
courses. The correlation between attitudes to- 
ward self and others in this group of 48 stu- 
dents was +.74 + .065 as determined by the 
Pearson product-moment method. This figure 
was somewhat above those reported by Sheerer 
[9] and by Stock [10], and so studies of other 
age groups were initiated to see whether an age 
trend would appear. 

The questionnaire was next given to another 
general psychology class of 77 students nearly 
all of whom were college freshmen or sopho- 
mores who began college immediately upon 
graduation from high school. The correlation 
between attitudes toward self and others in 
this group was +.54 +.081. 

With the hypothesis of relationship between 
age and self-others attitudes still an open ques- 
tion, the questionnaire was next administered 
to two high school groups. One such group 
was composed of 45 third-semester (first half 
of sophomore year) students from a high school 
in a middle-class, suburban area near Wash- 
ington, D. C. The mean C. A. of this group 
was 15.84 years (S. D. = 0.66 years). The 
correlation between self-others attitudes here 
was .67 + .082. The second high school 
group, from the same school and composed of 
41 eighth-semester students (mean C. A. = 
18.66 years; S. D. = 0.58 years), showed a 
self-others relationship in expressed attitudes 
to the extent of +.51 +.115. 


DISCUSSION 

It is apparent from these results that the 
self-others attitudes as measured in terms of 
an objective, multiple-choice questionnaire 
show substantial relationships far above that 
expected by chance. The results show also 
that the observations of clinicians in regard to 
self-others attitudes hold for normal or non- 
clinical populations; these attitudes are not, 
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therefore, a function of clinical status, malad- 
justment, or the like. There appears to be no 
consistent relationship with age insofar as 
this study explores that problem. 

One might look upon these results as an 
example of the comparability of the two con- 
cepts “inferred self’ and the “self present in 
awareness” [5]. The inferred self was what 
was studied by Sheerer and Stock; the self .in 
present awareness was studied in this investi- 
gation. Both approaches net essentially the 
same results when the relationship between 
self-others attitudes is examined. 

When this questionnaire reaches a more 
nearly complete state of development, it is 
likely to be of value in studies of personality 
change with psychotherapy. Some clinicians 
feel that our standard personality tests do not 
show reliable changes between pre- and post- 
therapy status partly because the test items 
are not related to the more “dynamic’’ as- 
pects of personality organization as the clini- 
cian sees them. This, of course, is an empiri- 
cal problem; the present questionnaire may 
serve as an entering wedge into such prob- 
lems. A questionnaire of this type might also 
prove useful in examining some of the many 
fruitful questions regarding the self suggested 


by Hilgard [5]. 


Received A pril J, 1950. 
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SOME PRACTICAL USES OF MMPI PROFILE CODING’ 


GEORGE S. WELSH 


VETERANS ADMINISTRATION MENTAL HYGIENE CLINIC, OAKLAND, CALIFORNIA 


METHOD of coding MMPI profiles has 
A been developed by Welsh [5] follow- 

ing the original work of Hathaway 
[3]. The purpose of such coding is first to re- 
duce the J’-scores of the MMPI scales to a 
form? which is more easily handled and, sec- 
ond, to emphasize the configurational aspects 
of the profile. 

The primary utility of such codes lies in 
the ease with which profiles can be treated. 
Codes can be filed as suggested by Hathaway, 
and the data are then in a convenient form 
for tabulation with regard to the frequency 
of particular profile configurations. A 
pool is available for profile-matching purposes 
in which the degree of similarity can be spec- 
ified. While this could be done from the 
profiles as drawn on the recording sheet, it is 
apparent that it would be infinitely more dif- 
ficult and time consuming. If, for example, 
the clinician were interested in profiles with 
a peak on the neurotic triad in which Hs > 
D> Hy, he could sort a stack of MMPI 
records and pull out those with this particu- 
lar shape at a great expenditure of time. With 
a file of coded cases, on the other hand, he can 
immediately locate all profiles with a 123 


1This paper is published with the permission of 
the Chief Medical Director, Department of Medi- 
cine and Surgery, Veterans Administration, who 
assumes no responsibility for the opinions expressed 
or conclusions drawn by the author. 

2The essence of the coding is that each scale is 
assigned a digit: Hs-1, D-2,...Ma-9, Si-0. These 
digits are then arranged in order from highest to 
lowest, i.e., the code digit of the scale with the 
highest 7-score will appear as the first number in 
the code and the digit of the scale with the lowest 
score will appear last. All code digits whose 
T-scores are within one point are underlined or 
set in italics. Elevations are indicated by the fol- 
lowing symbols: scores 90 or over are followed 
by *, 80 to 90 by ”, 70 to 79 ’, 60 to 69 -, 50 to 
59 /, 40 to 49:, 30 to 39 %, 
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code and quickly count the number of cases 
available. 

Another use of the code lies in ease of com- 
munication. The oral reporting of a list of 
T-scores takes some time and is even then in 
an awkward form which must be drawn into 
a profile before it is of any practical use. The 
code digits with their elevation symbols, how- 
ever, can be given in a matter of seconds and 
in a form which is useful immediately. It 
should be remembered that from the code it- 
self? the MMPI profile can be reconstructed 
with very little loss of accuracy in terms of 
T-scores if it is desired to present the profile 
in graphic form. 

The code also offers a shorthand way for 
clinicians to speak of particular profile con- 
figurations. Thus, if we have a profile of a 
conversion hysteric with an elevation of the 
neurotic triad into the 70’s with Hy higher 
than Hs and both higher than D and with 
Si as the lowest score lying in the extraverted 
end of the scale, this fact can be expressed 
quite simply as “312 prime with 0 down.” 

For the computation of tetrachoric corre- 
lations which might be used in factor or 
cluster analysis, the code may be conveniently 
utilized. A red pencil line is drawn through 
the fifth and sixth place digits (if ten scales 
are used), separating the scales into a high 
and low group. The frequencies required for 
calculation of the tetrachoric r can easily be 
obtained by assortment of the code cards thus 
divided. ‘The method has, in addition to con- 
venience, an emphasis on the relative position 
of the scales and the configurational aspect of 
the profiles which might not appear in the 
use of 7-scores for this purpose. 


®This, as well as most of the other points made 
in this paper, refers only to the extended code and 
not to the original method. 
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The above examples illustrate the first 
purpose of MMPI coding, the reduction of 
T-scores to a convenient and usable form. To 
exemplify the second purpose, emphasis of the 
profile configuration, data published in an 
article by Andersen [2] will be used. These 
data were T-scores on successive administra- 
tions of the MMPI to a psychiatric patient 
following lobotomy. As they stand, any pro- 
file configurations are difficult to discern. If 
they are drawn as a set of profiles on a re- 
cording sheet, it is almost impossible to follow 
the individual profiles in the confused welter 
of lines; even the use of differently colored 
pencils does not help much. If they are drawn 
as a series of profiles, six separate sheets will 
be needed and the advantages of simultaneous 
visualization will be lost. 

Let us look at Table 1 where the data are 
presented in code form.* The salient features 
of each of the six profiles with regard to both 
configuration and elevation are at once ap- 
parent, and a simultaneous comparison of the 
profiles is possible. A single scale such as De- 
pression can be traced by following the posi- 
tion of the digit, 2, in the successive codes. 
We see that it remains consistently in first 
place with the exception of the first post-oper- 
ative test where Schizophrenia, 8, appears 
first and the 2 has moved to third place. It 
is also seen from the codes that D is quite 
consistently high (in the 90’s), since it is fol- 
lowed by the elevation symbol * in all but one 
case. In a similar manner the place of Pd, 
both with regard to position among the scales 
and in terms of elevation, may be followed 
by observing the code digit, 4. 

It is particularly important, however, to 
note that relationships may emerge which are 
not easily anticipated either in the table of 
T-scores or in the graphic profile forms. In 
these particular data it can be seen that, al- 
though there is considerable variation in ele- 
vation and some shifts in scale position, the 
basic personality structure (as revealed by 
this test) remains essentially the same. This 
does not support the author’s contention that 


*The scores of the validating scales have been 
coded and placed at the end of the profile code. 
The writer is indebted to Mr. Harold Grable for 
this suggestion. 


there was “a progressive change from a typi- 
cally schizophrenic profile through a typically 
psychopathic profile.” D, Sc, Pt, and Pd oc- 
cupy the first four positions in all the codes 
and Ma is the last scale in all but one of the 
codes. Also, the several scales do not differ 
greatly from their averages, which have been 
computed from Andersen’s data. The average 
T-scores are as follows: ?-50.0, L-50.0, K- 
51.3, F-55.6, Hs-70.5, D-98.1, Hy-66.8, Pd- 
83.3, Mf-74.8, Pa-69.8, Pt-86.3, Sc-87.1, 
Ma-52.8, Si-69.6. Although there is a trend 
for Pd to rise in the last three profiles, the 
profiles are by no means typically psychopathic. 


It is of interest to note that the average 
ranks of the scales on the six profiles are: 
Hs-7.4, D-1.4, Hy-8.0, Pd-3.2, Mf-5.2, Pa- 
6.9, Pt-2.7, Sc-3.0, Ma-9.8, Si-7.2. The code 
of these ranks would be 2784560139, which 
is very similar to the code of the average T- 
scores. This latter code may be termed a 2 
star 874 double-prime with 9 low. It might 
be said here parenthetically that it has been 
found best to include the first four scales and 
the last scale in selecting profiles for similar- 
ity. 

In an article by Rubin [4]° an analysis of 
variance technique was used to show that no 
statistically significant differences existed be- 
tween average scale scores for four diagnostic 
groups. Yet, if these data are coded as in 
Table 2, it will be apparent that there are 
real configurational differences between the 
groups. The schizophrenic code shows the 
peak score on Sc with the typical elevated F 
and lowered K. The psychoneurotic and the 
alcoholic groups are differentiated by the re- 











TABLE 1 
ANDERSEN’s DATA IN Copep » Form 

Test = Code te 
Pre-Op. 27 84351"60-9 FK?L 
ist Post-Op. 8°7"2 45'106-93 FP L/K 
2nd Post Op. 2 7°8"4 56013-/9 F ? L/K 
3rd Post-Op. 28°471"5 603-9 FK ?L/ 
4th Post-Op. 24 7°805613-9 FP? L/K 
5th Post-Op. 24°" 78'5 360-19 KF ? L/ 

Average 2°8 74"5 1'603-9 FK #?L/ 





5This paper has been discussed by Aaronson and 
Welsh [1]. 























TABLE 2 
ProFiLce Copes oF Rusin’s DATA 

Diagnostic Term N : Code 
Paychotic 838 824-7169 3/5 F-? LK 

(schizophrenia) 
Psychoneurotic 28 24731-86965 KF? L/ 

(anxiety state, hys- 

teria, hypochondria- 


sis, neurasthenia, re- 
active depression, 


mixed NP) 

Chronic Alcoholic 8 42318/99766 KFL ?/ 
(without psychosis) 

Psychopathic 244837221596 FKL ?/ 








versal of the position of D and Pd as well as 
by the much higher place of Pt in the neurotic 
group. The alcoholic and the psychopath 
groups both show Pd as the peak score, but 
D is clearly lower and Sc much higher in the 
psychopath group. 

The writer feels that if series of MMPI 
profiles either for individuals or groups are 
coded and placed in tabular form, the data 
will be presented in a manner economical of 
space and more easily grasped; also, relation- 
ships and interpretive features which are not 
readily apparent in ordinary 
might then be discovered. 


presentation 


GEORGE S. WELSH 





SUMMARY 


MMPI coding is of value in reducing the 
T-scores to a form that may be handled con- 
veniently. The code is useful in filing data 
and in locating cases for research or clinical 
use. Ease and economy in communication re- 
sult from the use of coding. The placing of 
codes in tabular form may disclose relation- 
ships which were not easily seen in usual 
methods of presentation. 


Received May 13, 1950. 
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Books 


Ast, LAwrence E., AND BeLLaAK, Leopoitp. (Eds.) 
Projective psychology. New York: Knopf, 1950. 
Pp. xvii + 499. $6.00. 


A series of fourteen essays about projective tech- 
niques that vary greatly in intention and quality. 
Two introductory chapters by the editors attempt to 
frame a theory of “projective psychology” with in- 
different success. Among the ten chapters on various 
projective methods, Ruth Munroe’s is outstanding 
in presenting a full and useful manual for her Ror- 
schach inspection technique. Several other chapters, 
as those on Rorschach content analysis, the mosaic 
test, figure drawing and finger painting, abound 
with sweeping hypotheses supported by little or no 
evidence. In a chapter on the Szondi, Deri does not 
attempt a miniature manual but reports a research 
that might have been a good journal article if the 
groups had been large enough to justify statistical 
tests of significance. As a whole, the volume illus- 
trates clinical psychology’s major need, more per- 
sistent and more critical research on its basic in- 
struments. 


BrayFietp, ArtHur H. (Ed.) Readings in modern 
methods of counseling. New York: Appleton- 
Century-Crofts, 1950. Pp. xii + 526. $5.00. 


The editor has met a real need by placing in one 
volume an excellent selection of recent studies and 
contributions to counseling. He has given special 
emphasis to articles that deal with methods and 
processes. The material is well organized. This book 
has been planned for students in training and coun- 
selors whose jobs are located where there are only 
limited library facilities. The volume will enable 
both of these groups to have closer contact with re- 
cent literature in the field. However, it should also 
be of interest to those in allied professions, who will 
find in this volume an easy access to significant con- 
tributions in the field of counseling. —B. M. L. 


CoLEeMAN, JAMEs C. Abnormal psychology and mod- 
ern life. Chicago: Scott, Foresman, 1950. Pp. xi + 
657. $4.50. 


Tr 
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Note: Some reviews in this issue were prepared 
by the Associate Editors, who may be identified by 
ae ya Unsigned reviews are by the Editor. 
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This dramatically organized and profusely illus- 
trated textbook brings to abnormal psychology a 
format now popular among books in elementary 
psychology. It is attractive and lively, and at the 
same time almost encyclopedic in scope, a combina- 
tion of qualities not achieved easily. The worth of 
the book must be judged in relation to the needs of 
two kinds of students who might use it. For those 
who will subsequently follow a career in clinical 
psychology, the text has shortcomings in the lack of 
systematization and in the occasional outright loose- 
ness of its presentation of theory. Such students, 
however, constitute only a small proportion of those 
who study an undergraduate course in abnormal 
psychology. For the nonspecialist student the book 
is a storehouse of interestingly presented descriptive 
material, and a strong influence for the formation of 
constructive attitudes toward mental health prob- 
lems. 


Dorcus, Roy M., anp SHAFFER, G. WiLson. Tezxt- 
book of abnormal psychology. (4th Ed.) Balti- 
more: Williams & Wilkins, 1950. Pp. xvi + 717. 
$5.00. 


The fourth edition of this widely used textbook 
revises its material to comparatively recent date. Al- 
though the coverage is excellent, the critical reader 
will inevitably miss references in particular areas. 
Likewise, the chapter treatments are of somewhat 
unequal authority, perhaps because of the wide cov- 
erage. The organization of material is essentially 
academic rather than clinical, which is both an ad- 
vantage and a disadvantage for the clinical reader. 
We note from the jacket description that the organic 
neuroses now have a separate chapter, the mental 
disorders have been reclassified, the material on 
psychiatric therapy has been rewritten, the theories 
of disorders of central function are extensively revis- 
ed, and new case history materials and a glossary 
have been added. The advertising prospectus carries 
a statement of orientation well worth noting: “The 
abnormal man has the same desires as you. But the 
abnormal man has your desires in greater intensity 
— or at the wrong time — or his attempts to gratify 
them are unacceptable to society.” —E.A4.D. 


Ferenczi, S. Sex in psychoanalysis. New York: 
Robert Brunner, 1950. Pp. 338. $3.50. 


A reprint of fifteen papers by one of the pioneer 
psychoanalysts, which were published originally un- 





der the title “Contributions to Psychoanalysis.” 
Among the topics covered by the papers are impo- 
tence, homosexuality in paranoia, onanism, nosology 
of male homosexuality, interest in money, obscene 
words, symbolism, introjection and transference, and 
the development of reality. His theoretical discussion 
of concepts is illustrated by cases from his practice. 
The volume will continue to have value for students 
seeking to understand dynamic theory.—F. McK. 


Fisner, V. E. The meaning and practice of psycho- 
therapy. New York: Macmillan, 1950. Pp. xv + 
411. $5.00. 


In this persuasive teaching volume, Fisher pre- 
sents his eclectic approach to therapy by means of 
illustrative case studies of the therapeutic process. 
There is an introductory chapter on general meth- 
ods. Each of the succeeding twenty-two chapters 
takes up one common syndrome — early schizo- 
phrenia, hypochondria, phobia — describes it briefly, 
and gives a detailed account of the therapy of one 
case. Fisher’s eclectic method draws a little from 
all modern schools, but is no hodgepodge of compro- 
mises. Although he does not theorize explicitly, his 
case studies seem to reveal a framework that is 
highly in accord with sound learning theory. Each 
disorder is viewed historically as an outcome of iden- 
tifiable learning experiences. The varied therapeutic 
methods have a clear single objective, to make the 
person respond either symbolically or directly to the 
stimuli for his distress, under conditions conducive 
to relearning. Although Fisher’s therapy is more 
active than are most other current approaches, it 
seems effective and economical when used with 
skill. A real danger might lie in its attempted use 
by a less proficient worker who lacks the sharp un- 
derstandings required by so interpretative an ap- 
proach. 


Fopor, NANDOR, AND GAYNOR, FRANK. (Eds.) Freud: 
Dictionary of psychoanalysis. New York: Philo- 
sophical Library, 1950. Pp. xii + 208. $3.75. 


While this volume of quotations from Freud is 
arranged in dictionary form, it is hardly a dictionary 
in the usual sense. Most of its entries are not pre- 
cise definitions of terms, but are comments that 
Freud wrote about the concept. Indeed, rigorous 
definitions are notably absent, a fact that throws 
light on why psychoanalysis means many different 
things to different people. As an anthology through 
which to browse, the book has some interest and 
value. Those who might expect it to fulfill the usual 
functions of a dictionary will be disappointed. 


FROMM-REICHMANN, Friepa. Principles of intensive 
psychotherapy. Chicago:Univ. of Chicago Press, 
1950. Pp. xviii + 246. $3.75. 


This book is an elaboration of a lecture course 
given at the Washington School of Psychiatry, the 
Washington-Baltimore Psychoanalytic Institute in 
Washington, and the William Alanson White In- 
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stitute of Psychiatry in New York. The orientation 
and purpose of the book is set forth in the con- 
cluding paragraph of the author’s introduction, 
“As we set out to investigate and clarify the prin- 
ciples of intensive psychotherapy, we must study 
therefore not only the psychotherapeutic process as 
such, or the patient’s personality in terms of his 
interpersonal processes, but also the personality of 
the participant observer, the psychiatrist, in terms 
of his interpersonal relationships.” In the opinion 
of this reviewer, the investigation is unusually 
competent and thorough and genuinue clarification 
results. The reading of this book should not only 
be considered a professional “must” for the clini- 
cian, but it can be anticipated as genuinely enjoy- 
able and rewarding.—W.A.H. 


Gupert, G. M. The psychology of dictatorship. 
New York: Ronald, 1950. Pp. viii + 327. $4.00. 


The psychology of authoritarian government is 
viewed from two approaches: a_ psychocultural 
analysis of why a group has a need to accept 
dictatorship, and a clinical study of the leaders 
who focus that need. Much of the information 
about the Nazi leaders—revolutionists, reaction- 
aries and militarists—was obtained from the 
author's first-hand studies during the Nuremberg 
trials. Their diverse backgrounds, personalities and 
motivations refute the simplification of calling them 
all psychopaths. They emerge, even through their 
disreputable deeds, as clinically understandable 
human beings. 


Greco, MARSHALL C. Group life. New York: Phil- 
osophical Library, 1950. Pp. xvi + 357. $4.75. 


The author expresses his feelings about the social 
bases of neuroses in a volume characterized more 
by the warmth of conviction than by the light of 
understanding. 


Guitrorp, J. P. AnD Love_t, Constance. Advanced 
statistical exercises. Beverly Hills, Calif.: Sheri- 
dan Supply Co., 1950. Pp. ii + 110. 


A comprehensible statistical workbook that can 
help students to learn the computation and use of 
many of the more elaborate statistical methods ap- 
plicable to clinical research. 


Harris, Ropert E., Micier, JAMes G., MUENCH, 
Georce A., Stone, L. JosepH, Teusper, HANS- 
LUKAS, AND ZUBIN, JosepH. Recent advances in 
diagnostic psychological testing. Springfield, IIl.: 
Charles C Thomas, 1950. Pp. x + 120. $2.75. 


In its six critical reviews, each by an exception- 
ally qualified author, this small monograph offers 
more meat than does many a more pretentious book. 
A number of important central ideas for the future 
development of psychodiagnosis seem to emerge in- 





Si 


ir 
le 


‘il- 


ial 
pre 


of 


ced 


eri- 


can 
> of 


NCH, 
ANS- 
5 in 
Ill: 
15. 


tion- 
fers 
pook. 
uture 
e in- 


BOOKS AND TESTS 87 


dependently from its several chapters. For example, 
research originating in varied settings points more 
and more clearly to a measurable human character- 
istic of general goodness of adjustment, or ego 
strength, or therapy-readiness. Such a concept has 
sweeping implications both for practical clinical 
diagnosis and for personality theory. All clinical 
psychologists will find the monograph entirely de- 
serving of their careful attention. 


HARTLEY, Eucene L., Bircw, Herpert G., AND 
Hartiey, Rutu E. (Eds.) Outside readings in 
psychology. New York: Crowell, 1950. Pp. xiii 
+875. $2.75. 


A paper-bound collection of 98 readings for the 
introductory psychology course. The inclusion of 
many articles bearing on dynamic psychology shows 
the extent to which clinical concepts have penetrated 
the general field. 


Hunt, J. McV., AND Kocan, Leonarp S. Measur- 
ing results in social casework. New York: Family 
Service Assoc. of America, 1950. Pp. 79. $1.50. 


This is a manual describing the development of 
the Movement Scale and instructions for its use. 
The Movement Scale is an instrument designed to 
measure the changes which occur in clients and 
their situations during extended social casework 
treatment. It was constructed by the application of 
judgment-scaling techniques to actual case mater- 
ials. Average intercorrelations between independent 
ratings based on case materials alone vary be- 
tween .74 and .80. Such ratings also show a corre- 
lation of .80 with judgments of movement made by 
the caseworker who handled the case. The detailed 
instructions for using the scale are accompanied by 
illustrative case summaries. This instrument ap- 
pears to have considerable promise both as an ad- 
ministrative and as a research tool.—E. L. K. 


Lerever, D. Wetty, Turrett, ArcHie M., AND 
Werrze., Henry I. Principles and techniques of 
guidance. (Rev. Ed.) New York: Ronald, 1950. 
Pp. xvi +577. $4.25. 


This new edition stresses an increased integra- 
tion of guidance with classroom work and greater 
teacher participation, with emphasis on vocational 
guidance. In addition to presenting broadly con- 
ceived general principles of guidance, the authors 
discuss both group and individual approaches, and 
techniques for evaluating guidance programs. The 
text is detailed, suggestions are specific, and the 
bibliography is extensive —A. R. 


NaumBurc, MArcaret. Schizophrenic art: its mean- 
ing in psychotherapy. New York: Grune & Strat- 
ton, 1950. Pp. viii + 247. $10.00. 


The entire volume is devoted to a detailed dis- 
cussion of the progress of two schizophrenic girls, 
eighteen and twenty-five years of age, in art thera- 


py, and to a brief review of the literature of neurotic 
and psychotic art. The reporting of the clinical ma- 
terial is dynamic, the diagnostic and therapeutic ele- 
ments flowing naturally and simultaneously as the 
treatment progresses. The book is profusely illustrated 
with the art productions of the two patients, much 
of it in color. In make-up, this is one of the most 
beautiful psychological volumes the reviewer has 
seen. The cases and the illustrations are so pre- 
sented that the reader can follow the progress of 
treatment by studying the art forms at the different 
stages of personality disorganization or organiza- 
tion. The volume is particularly interesting because 
the author is an educator who has apparently been 
successful with extremely difficult types of therapy, 
working under the direction of psychiatrists. Most 
psychiatrists will not attempt to treat schizophrenics 
as ill as the two girls who were treated rather suc- 
cessfully by Margaret Naumburg. —M. K. 


Rennie, Tuomas A. C., Buriinc, TEMPLE, AND 
Woopwarp, Lutuer E. Vocational rehabilitation 
of psychiatric patients. New York: Common- 
wealth Fund, 1950. Pp. ix+-133. 75¢. 


After discharge from a psychiatric hospital, a 
recovered patient often presents special needs for 
vocational counseling, rehabilitation, and place 
ment. This monograph calls attention to the prob 
lems, summarizes the findings of surveys and re 
search, and describes the resources available for 
guidance and_ rehabilitation. Psychologists with 
competence in both the clinical and vocational fields 
may find the ex-patients of mental hospitals a 
challenging group for research and for service. 


RoHEIM, Geza. Psychoanalysis and anthropology. 
New York: International Universities Press, 1950. 
Pp. xx + 496. $10.00. 


In a volume rich with first-hand observations on 
infant development and sex life in a number of di- 
vergent cultures, Roheim supports his well-known 
theory of the universality of the oedipus complex. 
He does not argue, however, for a universal basic 
personality. His descriptions emphasize wide per- 
sonality differences among individuals and among 
subgroups, in both primitive and modern cultures. 


SeLover, Marcaret ef al. Introduction to testing 
and the use of test results. Educational Records 
Bulletin No. 55. New York: Educational Records 
Bureau, 1950. Pp. vii + 107. 


| 


A manual on the uses of tests in guidance, pre- 
pared especially for the in-service training of 
teachers in independent schools, but usable with 
other groups. 


Tuorne, Freperick C. Principles of personality 
counseling. Brandon, Vt.: Journal of Clinical 
Psychology, 1950. Pp. xv + 491. $5.00. 


While this text purports to be eclectic, it is really 
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the most lucid description of “directive” therapy so 
far offered. The principles of directive counseling 
can be read most clearly between the lines. One evi- 
dent principle is never to trust a client or his re- 
sources, but to manage him as cleverly as possible 
for his own good. Effective techniques for bringing 
a client into complete submission may range from 
masterful inactivity (p. 177), to giving him finan- 
cial advice (p. 315), and in extreme cases to lock- 
ing him in solitary confinement for an average of 
4.66 days (p. 263). Such common-sense expedients 
may be serviceable in making people behave. There 
can be more than a little doubt, however, that they 
fall within the usually accepted meaning of psy- 
chotherapy. 


Wotrr, Werner. Values and personality. New 
York: Grune & Stratton, 1950. Pp. x + 239. 
$4.75. 


The “existential” psychology proposed by Dr. 
Wolff in this book “deals with the psychology of 
man as far as he questions his existence.” The term 
existential as used by Dr. Wolff is not the same as 
used by the Existentialists, nor is it easily defined. 
“Everything is existentially real that becomes func- 
tional in an individual challenging his existence 
with growth and with destruction.” While he ac- 
cepts most of analytic theory and practice, he states 
that “psychoanalysis neglected the fact that man’s 
act of rationalizing his determination is spontaneous 
and free,” and “the cause of neurosis. . . .is man’s 
direct experience of having lost his connection with 
the universe.” When he later states that “the main 
root of neurosis is a disturbance in one or more 
areas of the creative process,” presumably the dis- 
turbance is the result of the experience stated pre- 
viously. He focuses his therapeutic aim upon the 
releasing of man’s creative forces. From the two 
cases reported in the book, it does not appear that 
his technique differs from that of analysis.—A.R. 


VERNON, Puiwip E., AND Parry, JOHN B. Personnel 
selection in the British forces. London: Univ. of 
London Press, 1949. Pp. 324. $4.50. 


Part I of this volume is devoted to a historical 
account of the personnel selection procedures utilized 
during World War II in the British Army, Navy, 
and Air Force. Part II is a more general discussion 
of the principles of vocational selection and guid- 
ance. Although addressed primarily to educators 
and representatives of industry,g American psy- 
chologists will appreciate the opportunity of famili- 





BOOKS AND TESTS 


arizing themselves with hitherto unpublished find- 
ings concerning a number of tests and other selec- 
tion procedures used in the British Forces. The re- 
port includes a bibiliography of some 200 items, 
many of which are infrequently seen.—E. L. K. 


TESTS 


LEITER, RUSSELL AND PARTINGTON, JOHN A. 
Leiter-Partington Adult Performance Scale. Man- 
ual, pp. 33. Washington: Psychological Service 


Center Press, 1950. 


nm 
As., 


The L-P Performance Scale consists of the three 
nonverbal subtests of the Army Individual Test 
during World War II: the pathways 
test, a stencil design test employing round patterns, 
and a painted cube assembly test. The reliability of 
the whole scale is not given, but its correlation 
with the Revised Stanford Binet is .78 in a group 
of 256 adult males. The intercorrelations of the 
three subtests range from .45 to .69. Tables of 
norms give adult MA’s and IQ’s for each subtest 
separately and for the battery. Since the materials 
novel and do not seem childish, the scale of- 
a useful addition to resources for the nonver- 
The manual discusses 
obtained from the 
that may have values in psychological diagnosis. 


developed 


are 
fers 
bal 


qualitative 


examination of adults. 


observations tests 


McHucu, Geworo et al. Sex Knowledge Inventory. 
Adult, for individual or group marriage coun- 
seling. Form X, for counseling: test 
booklet (75¢ each), answer pad ($2.25 per 25), 
and manual, pp. 64 ($1.50). Form Y, vocabulary 
and anatomy: test blank ($2.25 per 25), with 
key. Sample set ($3.50). Durham, N. C.: Family 
Life Publications, 1950. 


marriage 


Form X consists of 80 multiple-choice questions 
covering information, attitudes and misconceptions 
pertinent to marriage counseling. A carbon-paper 
answer pad permits automatic scoring to make the 
results immediately available for counseling. While 
norms are in preparation, the use of the blank for 
counseling does not require normative data. The 
manual discusses the implications of each question 
as an adjunct to marriage counseling. Form Y is a 
supplementary test, of 105 items mainly in match- 
ing form, on the vocabulary and anatomy of repro- 
duction and sex. It is recommended as an aid in 
selected cases of marriage counseling, or for sex 
education classes. 
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PSYCHOLOGICAL MONOGRAPHS: GENERAL 
AND APPLIED 


Volume 64, 1950 
Patterns of Personality Rigidity and Some of Their Determinants. Seymour Fisher, 
Elgin State Hospital. $307, $1.00 


The Value of an Oral Reading Test for Diagnosis of the Reading Difficulties of 
College Freshmen of Low Academi-: Performance. Charles A. Wells, American 
International College. $ 308, $1.00 


Rorschach Responses Related to Vocational Interests and Job Satisfaction. Solis 
L. Kates, Michigan State College. $309, $1.00 


Symbol Eiaboration Test (S.E.T.): The Reliability and Validity of a New Projec- 
‘ive Technique. Johanna Krout, Chicago Psychological Institute. $310, $2.00 


Changes in Responses to the Minnesota Multiphbasic Inventory Following Certain 
Therapies. William Schofield, University of Minnesota. $311, $1.00 


A Seale for Measuring Teacher-Pupil Attitudes and Teacher-Pupil Rapport. Carrol! 
H. Leeds, Furman University. $312, $1.00 


The Nature and Efficacy of Methods of Attack on Reasoning Problems. Benjamin 
Burack, Roosevelt College. $313, $1.00 


The Validity of a Multiple-Choice Projective Test in Psychopathological Screening. 
Martin Singer, VA Hospital, Long Island. $314, $1.00 


A Normative Study of the Thematic Apperception Test. Leonard D. Eron, Yale 
University. $315, $1.50 


Experimentally Induced Variations in Rorschach Performance. Edith E. Lord, 
Arizona State Department of Health. £316, $1.00 


An Evaluation of Personality-Trait Ratings Obtained by Unstructured Assessment 
Interviews. Ernest C. Tupes, United States Air Force. ¢317, $1.00 


American Psychological Association 


1515 Massachusetts Avenue N.W., Washington 5, D.C. 

















NEUROLOGY 
& PSYCHIATRY 


Section VIII of Excerpta Medica 


The Neurology Section includes abstracts of all ar- 
ticles on neurological surgery in addition to general clin- 
ical neuro-physiology. 


The section on Psychiatry covers the topics usually 
contained within the meaning of the word. In addition, 
the following special branches are dealt with fully: 


* Psychoanalysis, individual and analytical psychoiogy 


* Sexuology, criminology, alcoholism, and drug addic- 
tion as related to psychiatry 


Social and industrial psychology and psychiatry, vo- 
cational guidance and mental! testing 


Psychometrics 
Personality testing and the Rorschach test 


Heredity and statistical studies as they apply to psy- 
chiatry 


* Mental defect and epilepsy 


Annual volume of 1000 pages, including an index classi- 
fied by author and subject. 


Subscription price $22.50 per annual volume 


THE WILLIAMS & WILKINS COMPANY 
Agents for the United States, Canada and Central America 


Mt. Royal and Guilford Aves. Baltimore 2, Maryland 
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